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EDGEWORTH EXPANSIONS FOR STUDENTIZED STATISTICS 
UNDER WEAK DEPENDENCE^ 

By S. N. Lahiri 

Texas A & M University 

In this paper, we derive valid Edgeworth expansions for studen- 
tized versions of a large class of statistics when the data are generated 
by a strongly mixing process. Under dependence, the asymptotic vari- 
ance of such a statistic is given by an infinite series of lag-covariances, 
and therefore, studentizing factors (i.e., estimators of the asymptotic 
standard error) typically involve an increasing number, say, i of lag- 
covariance estimators, which are themselves quadratic functions of 
the observations. The unboundedness of the dimension £ of these 
quadratic functions makes the derivation and the form of the expan- 
sions nonstandard. It is shown that in contrast to the case of the 
studentized means under independence, the derived Edgeworth ex- 
pansion is a superposition of three distinct series, respectively, given 
by one in powers of n"^''^, one in powers of [n/£]~^^'^ (resulting from 
the standard error of the studentizing factor) and one in powers of 
the bias of the studentizing factor, where n denotes the sample size. 

1. Introduction. Studentized statistics (or t-statistics, in short) play a 
fundamental role in statistical inference about an unknown parameter. For 
example, construction of a confidence interval for a parameter 9 and testing 
of hypotheses about 9 are typically based on studentized statistics. However, 
in spite of its critical importance and uses, a complete understanding of the 
higher-order properties of studentized statistics for dependent observations 
remained elusive to date. As explained below in some details, a primary 
reason for this is that the standard Edgeworth expansion (EE) theory does 
not easily apply to the case of a studentized statistic under dependence. This 
paper develops the necessary tools and establishes valid EEs of a general 
order for a large class of studentized statistics under weak dependence. Such 
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EE results are important for investigating higher-order properties of tests 
and confidence intervals, such as coverage accuracy of one and two-sided 
block bootstrap confidence intervals and their iterated versions, power levels 
of tests under contiguous alternatives, etc., and for constructing inference 
procedures with higher-order accuracy. 

To highlight the major theoretical issues associated with the problem, let 
{-^i}i^-oo ^ sequence of stationary random variables with EZi = and 
EZf = (T^ S (0,00). Let Zn = Yli=i Zi, n> 1. When the Zj's are inde- 
pendent and identically distributed (i.i.d.), n^^'^Zn is asymptotically normal 
with mean zero and variance cr^. In this case, n^l'^Zn may be studentized 
using the scaling random variable 



-i.i.d. 



1/2 



-'Y.^l-zi 

and therefore, the studentized sample mean 

T^-^- = ^l''Z^lcji:-^- 

may be expressed as a smooth function of the sample mean, J27=i(^i^ ^f)' ^ 
of the bivariate random vectors {Zi,Zfy,i = 1, . . . ,n. Here and in the fol- 
lowing, let A' denote the transpose of a matrix A. An Edgeworth expansion 
for T^j''*^' can be derived using the well-known results on EEs for sums of 
i.i.d. random vectors and the transformation technique of Bhattacharya and 
Ghosh (1978). 

The problem of deriving EEs for studentized sample mean becomes con- 
siderably more difficult when the Zj's are dependent. In the dependent case, 
under suitable moment and mixing conditions on the Zj's [cf. Ibragimov and 
Linnik (1971), Athreya and Lahiri (2006)], n^^'^Zn is asymptotically normal 
with zero mean and variance 



00 

(1-1) a^=7(0)+2^7(/c), 

k=l 



where ^{k) = Cov{Zi, Zk+i), k £Z and Z = {0, ±1, ±2, . . .} is the set of 
all integers. Thus, for studentizing Zn, one needs to estimate all the lag- 
covariances 'y{k)'s, eventually, as the sample size n goes to infinity. In prac- 
tice, one typically estimates a (large) number i (say) of the lag-covariance 
terms and let i = in tend to infinity with n suitably. For example, with 
7„(/c) = X]r=f ZiZi^k — Zn, 1 < k < n, a studentized version of n^^'^Zn 
may be defined as 

(1.2) Tr = n'/'Zn/ar, 

where 0"°^^ = max{7„(0) + 2 ^^^^^ 7„(A;), (or a suitable variant of 

it). However, note that unlike the i.i.d. case, the studentized statistic r°^^ 
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is now a function of (£ + 2) means, viz., Z„, n~^Yl^=i ^i^i+k:^ l£ k < 
where ^ — )■ oo as n — )• oo. It is precisely because of the unbounded dimen- 
sionahty of the means in the definition of T°^^ that the standard techniques 
of deriving EEs do not apply to the studentized statistics in the dependent 
case. Using some specialized arguments, two-term EEs [with errors of order 
o(n~^/^)] have been independently derived by Gotze and Kiinsch (1996) and 
Lahiri (1996a). In a recent work, Velasco and Robinson (2001) obtained a 
third-order EE for the studentized sample mean for a Gaussian time series, 
using an exact Fourier inversion formula that is available only under the 
Gaussian assumption, but not in general. In this paper, we derive EEs of a 
general order for studentized versions of a large class of estimators based on 
different classes of commonly used studentizing factors under dependence. 
In particular, as regularity conditions on the underlying process, we only re- 
quire some moment and weak dependence conditions as in Gotze and Hipp 
(1983), but not Gaussianity. The arguments developed here builds upon 
a recent work of Lahiri (2007) and the seminal paper of Gotze and Hipp 
(1983) (hereafter referred to as [L] and [GH], respectively) on EEs for sums 
of dependent variables and also, critically relies on a representation result 
of Bradley (1983). 

To describe the main results of the paper, let {Xi}i^z be a sequence of M*^- 
valued stationary random vectors with EXi = fj,, where (iGN = {l,2,...}, 
the set of all positive integers. Let X„ = n~^Y17=i-^i denote the sample 
mean of Xi, . . . ,Xn- Suppose that 0„ is an estimator of a parameter of 
interest 6 based on Xi , . . . , Xn such that 

(1.3) en = H{Xn) and e = H{^j) 

for some (smooth) function : M'^ — t- M. This is the smooth function model 
of Bhattacharya and Ghosh (1978) [cf. Hall (1992)], which serves as a con- 
venient, yet a general theoretical framework for studying EEs for a large 
class of commonly used statistics. Examples of statistics that can be treated 
under (1.3) include the sample mean, the sample auto-correlations and the 
Yule-Walker estimators of autoregressive parameters in an auto-regression 
model. The main results of the paper are also applicable to the class of 
generalized M-estimators of Bustos (1982), which are given by measurable 
solutions of estimating equations of the form 

n—p 

(1.4) ^V(^^,•••,^^+p-l;^n)=0 

i=l 

for some 

^ . ^dp+i (see Remark 3.1 in Section 3 for details). 

Note that under (1.3), the asymptotic variance of n^^^{6n — 0) is given by 



oo 



ri^Hf,)' r(.) Hf,), 



-oo 
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where T{i) = Cov(Xo, Xi) = E{Xq — fJ.){Xi — fi)' , i G Z and where h{-) is the 
dx 1 vector of first-order partial derivatives of H. Here, we consider a class 
of studentizing factors of the form 



= max^ h{Xn)' 

(1.5) 



r„(0) + ^u;fc„{f„(fe) + f„(A:)'} 



=1 



h{Xn),n 



-1 



= max{f^„,n ^} say 



(and also some of its commonly used variants; see Section 4), where Wkn S 
M,l < k < i are nonrandom weights, where for n > 1, £ = G (1,?^), are 
integers such that + n~^£n = o(l) as n — ?• oo, and where 



n—k 



tn{k) = ^{X, - Xn){Xi+k - Xn)' 



= 1 



is a version of the sample auto-covariance matrix at lag k, 1 < k < n — 1. 
The studentized estimator is now given by 

(1.6) T„ = ni/2(^„-^)/f„. 

(For certain choices of WknS, the first term in the definition of can be 
negative or zero, albeit with small probability. The factor in the defi- 
nition of ensures positivity of the scaling factor and thereby makes the 
studentized statistic T„ well defined.) The main results of the paper give 
EEs for Tn (and its variants) of order s for any given integer s > 3. Not 
only are the arguments used for proving the EEs in the dependent case are 
different from those in the independent case, the forms of the EEs are also 
strikingly different. Recall that in the independent case, EEs for studentized 
statistics are given by a series in powers of n~^/^: 

(1.7) P{Tl-}-'^- <x) = $(x) + n~^/^pi{x)cp{x) + n-^p2{x)(l){x) + • • • , 

uniformly in x G M, where ^{■) and (/>(•), respectively, denote the distribution 
and the density functions of a A'^(0, 1) variate, and pj(-)'s are some polyno- 
mials. In contrast, the EEs in the dependent case are super-impositions of 
three distinct series in powers ofn~^^'^, bn^^'^ and [cf. (3.8), Proposition 
3.2 below]: 

P{Tn <x) = ^{x) + a-^qi{x)(l){x) + n-^/2^2(x)0(x) 

(1-8) 

+ K q3{x)(i){x) H — , 

where ^i(-)'s are some polynomials, bn = n/£ and is of the same order as 
the bias of f^. In (1.8), the n~^/^-series results from the centered and scaled 
sample mean n^/^(X„ — /i) as in [GH]. The terms in the a^^-series and the 
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bn -series result from the estimation of the asymptotic variance by the 
"truncated series" estimator f^; Here, the 6^ "^'^^-series is determined by the 
stochastic part of and the -series is determined by the determinis- 
tic truncation error (or the bias of the estimator). We point out that the 

coefficient of the bn -term in the EE of T„ in (1.8) is zero, but those of 

— 1/2 

the higher powers of bn typicaUy are not. To provide further insight into 
the interactions among the three series and for ready reference, we provide 
exphcit expressions for the terms in the EE for T„ with an error of order 
o{n~^) in Section 3 below. It is evident from this explicit EE [cf. (3.8)] that 

interactions between the n~^/^-series and the ftn^^^-series show up only in 
the terms of order smaller than n~^/^, and hence, the existing second-order 
EE results fail to provide any clue to the complex pattern of interactions 
between these series. In addition to the general-order EE for T„, we also 
establish valid EEs of a general order under alternative forms of studenti- 
zations, including those based on various block bootstrap and subsampling 
methods. 

The rest of the paper is organized as follows. We conclude this section 
with a brief literature review. In Section 2, we introduce the theoretical 
frameworks of [GH] and [L] and state the assumptions. Here, we also verify 
these assumptions for a class of vector linear processes. In Section 3, we 
present the main results under the smooth function model. EE results under 
other commonly used choices of the studentizing factors are given in Section 
4. Proofs of the main results are given in Sections 5 and 6. 

There is a vast literature on EEs for the sample mean Xn and for statis- 
tics that are smooth functions of Xn- For independent random vectors, a 
detailed account of the EE theory for Xn is given by Bhattacharya and 
Ranga Rao (1986) (hereafter referred to as [BR]) and Petrov (1975), and 
the theory under the "smooth function model" is given by Bhattacharya 
and Ghosh (1978), Bhattacharya (1985), and Hall (1992), among others. 
For weakly dependent random vectors, [GH] obtained EEs for Xn under a 
very flexible framework. Lahiri (1993) relaxed the moment condition used 
by [GH] and settled a conjecture of [GH] on the validity of expansions for 
expectations of smooth functions of Xn ■ Applicability of [GH] results in dif- 
ferent time series models have been verified in Gotze and Hipp (1994). EEs 
for Xn under polynomial mixing rates have been given by Lahiri (1996b). 
Second-order expansions for certain versions of studentized statistics under 
weak dependence are given by Gotze and Kiinsch (1996) and Lahiri (1996a). 
Velasco and Robinson (2001) derived third-order edgeworth expansion for 
a studentized version of the sample mean for a stationary Gaussian pro- 
cess. EEs for sums of block- variables are recently given in [L]. The results 
of this paper establish EEs for most commonly used versions of studentized 
statistics under weak dependence and extend earlier results on the problem, 
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where the complex pattern of interactions among the three series were not 
very clear. 

2. Theoretical framework and assumptions. For deriving EEs for the 
studentized statistic T„, we will adopt a general framework similar to the 
one introduced by [GH] in the context of establishing valid asymptotic ex- 
pansions for sums of weakly dependent random vectors. Suppose that the 
stationary sequence of random vectors {Xjjjgz are defined on a probabil- 
ity space P). Also, suppose that {'Dj}'jl_^ is a given collection of 
sub cr-fields of Let Vp = cr{'Dj : j G Z,p < j < q), — oo < p < q < oo. For 
any two sub-sigma- fields 0,71 of define the a-mixing coefficient between 
g and n as a{g,n) = sup{|P(A nB)- P{A)P{B)\ ■.AGg,B€ n}. For 
notational simplicity, we set fi = EXi =0 in the statements of the assump- 
tions below, unless there is some scope of confusion. [If in an application 
then replace Xi's in (A.1)-(A.6) below with (Xi — ^)'s.] For i G let 
Xi = {Xi^i, . . . jXi^d)' and let be a [di = d{d + l)/2]-dimensional vector 
with (p, q)th element 



II ^ — ^ 



(2.1) 



k=l 

l<P<q<d, 



where Wikn = Wkn for 1 <i + k <n and Wikn = for i + k > n. Next, define 
the block variables 

(jgAn jlAn \ ' 

where Yin = Y^ — EY^ and 6on, = In/il. Here and in the following, for 
a; G M, we write [x] to denote the smallest integer not less than x and [x\ 
to denote the integer part of x. Also, we write || • || to denote the Euclidean 
norm of a vector and the spectral norm of a matrix, i.e., ||(xi, . . . = 
E^il3;•]l/^ (xi,...,Xfe)' G M'^ and \\A\\ = sup{\\Ax\\ : x e R'' ,\\x\\ = 1} for 
a r X fc matrix A, where r. A: G N = {1, 2, . . .}. For a random vector U and 
7 G (0,oo), let \\U\\^ = Let / = ((/i^)) denote the {dxd matrix- 

valued) spectral density function of the process {Xi}i^i. Set i = and 
<5„ = 6n^'"'^/'(logn)-2, n>2. 

We shall make use of the following assumptions for deriving an (s — 2)th 
"order" EE for T„, for a given integer s > 3. Note that an [s — 2)th "order" 
EE here is interpreted as a uniform approximation to the distribution of 
Tn with an error term o{bn^^ ^^/^). This may be contrasted with the more 
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familiar notion of order in classical EEs in the independent case (e.g., for 
T^'^'*^'), where the error of an (s — 2)th-order EE is o(n~^^~'^^^'^). This dis- 
tinction is important as the error of approximation in the dependent case 

— 1/2 

is determined by a coarser series (in powers of bn compared to a series 
in powers of resulting from estimation of the infinite-dimensional 

parameter /(O). 

Assumptions. 

(A.l) (i) There exists a constant K € (0, 1) such that for all n > K^^, K log n < 

(ii) The function : M'^ ^ M in (1.3) is [i^{s) + 2]-times differentiable 
in a neighborhood of ;U = EXi and /i(/i) 7^ 0, where 

i/(s)=inf{rGN:n^''/2(logn)(^+^)/2^0(5„) as n ^ 00} 

and where recall that h{-) is the dx 1 vector of first-order partial 
derivatives of H. 

(A. 2) (i) There exists a constant k G (0, 1) such that sup{||VFj„||s+K : 1 < 
3 < bon,n> 1} < K"^ 

(ii) The dxd matrix /(O) is nonsingular and Aqo = lim„_s.oo Cov(-^ x 

X^ILi ^in) exists and is nonsingular. 

(iii) sup{|wfc„,| :l<A;<^,n>l}<oo and lim.„_>.oo | — 1| = for 
each k>l. 

(A. 3) There exists a constant k G (0, 1) such that for all m > and for 
all j >1, there exist a Pj^'i^-measurable such that 

E\\Xj - X^Jl < exp(-K;m). 

(A. 4) There exists a constant k E (0, 1) such that for all n,m = 1,2, ... , 

a(P!!^,P~ ^) < K-iexp(-K?n). 

(A. 5) There exists a constant k E (0, 1) such that for all i, j,k,r,m = 1,2,... 
with i < k < r < j and m > k~^, 

e(sup \P{A\Vj:j (j^ [k,r]) - P{A\Vj:j € [i - m,k) U {r,j + m])\] 
< exp(— Km). 

(A. 6) There exists a constant n E (0, 1) and a sequence {(i„} C [l,oo) with 
dn = 0{i) and d'^ = 0(6^"'^) such that for all n > and <m< 
[logJi]^/'^, 

(2.3) max E 



sup 






t&B„ 







jo+m 



1 = 10— m 



Jo 



< 1 
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where J„ = Jn(m) = {m + 1, . . . , 6on — m — 1}, Bn = € M'^ : K(i„, < 
||t|| < and V,, ^ f),,im,i) = a{{D^:j e'L,3i [(jo - [f J)^+ 

i,(io + LfJ+iK]}. 

Now we comment on the assumptions. As in [GH], here we formulate the 
assumptions in terms of the auxiUary cr-fields T)j 's in order to allow for more 
flexibility and generality in applications. (A.l)(i) is a growth condition on 
the block length I and allows I to grow at a rate 0(ril^/^l~'^) for an arbitrar- 
ily small K > 0. Most of the commonly used variance estimators use an ^ in 
the range specified by (A.l)(i). For example, for the overlapping or nonover- 
lapping block bootstrap variance estimators based on blocks of length the 
(MSE-) optimal rate for (. is 0{n^/^) [cf. Kiinsch (1989), Hah, Horowitz and 
Jing (1995), Lahiri (2003)], for weights WknS based on symmetric kernels, 
the optimal rate of £ is 0(n^/^) [cf. Priestley (1981)], and for weights based 
on flat-top kernels, the optimal rate of £ is O(logn) under exponential strong 
mixing conditions [cf. Politis and Romano (1995)]. (A.l)(ii) is a smoothness 
assumption on the function H. The order z/(s) is determined by the rela- 
tive sizes of n and I. In particular, if is (s + l)-times differentiable in a 
neighborhood of ^ with /i(/u) ^ 0, then (A.l)(ii) holds for all choices of i 
satisfying (A.l)(i). 

Assumption (A.2)(i) is a moment condition on the block variables Wj^^'s 
and can be weakened slightly, where boundedness of the (s + K)th abso- 
lute moments of WjnS is replaced by sup{£^|| Wj^H* log(l + || W^jnll)"''''*'* -j = 
1, . . . , bQn,n > 1} < for some a{s) > 2s^ and k £ (0, 1) (cf. [L]). A simple 
sufficient condition for (A.2)(i), assuming (A.2)(iii), is that £'||Xi|p('^+^)+'' < 
oo for some k > 0. This can be proved using the arguments used in the proof 
of Lemma 3.28 of [GH]. 

Next consider assumption (A.2)(ii). The two parts of (A.2)(ii) jointly im- 
ply that the limiting covariance matrix of the normalized sum ftgn Yl^=i 
exists and is nonsingular. Note that when the weights WknS are generated 
through a bounded weight function tt; : [0, 1] — ?• M as 

(2.4) Wkn = w{k/£), 0<k<e, 

simple sufficient conditions on w{-) guaranteeing the existence of Aqo are 
known [cf. page 699, Priestley (1981)]. Also, in this case, (A.2)(iii) holds 
if w{0) = 1. However, the main results of the paper remain valid for more 
general weights, as long as assumption (A. 2) holds, and therefore, it is not 
necessary to assume that the weights be generated through (2.4). 

Assumption (A. 3) is an approximation condition that connects the vari- 
ables Xj's to the strong-mixing property (A. 4) of the auxiliary fj-fields ^^j's. 
The exponential decay of the strong mixing co-efficient in (A. 4) can be weak- 
ened to a suitable polynomial rate as in Lahiri (1996b), but at the expense of 
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a much longer proof. We do not pursue such refinements here to save space. 
Assumption (A. 5) is an approximate Markov condition and is a variant of 
a similar condition used by [GH]. This condition holds if the original ran- 
dom vectors Xj's are generated by a Markov chain. Although assumptions 
(A.3)-(A.5) may seem to have some overlap, in general, none of (A.3)-(A.5) 
implies the other (s). However, in a specific application, it may be possible to 
deduce one or more of these assumptions from the rest and can be dropped. 
For example, if the random vectors are strongly mixing at an 

exponential rate and if we set T>i = cr(Xj) for all i, then assumption (A. 4) 
holds and (A. 3) becomes redundant (by choosing Xi^m = Xi for all m > 1). 

Finally, consider assumption (A. 6), which is a stronger version of a condi- 
tional Cramer's condition on the block variables Wj^s given in [L] (see also 
condition (2.6) in [GH]). From the proof of the main result (Theorem 3.1), 
it is evident that the studentized statistic under consideration is a smooth 
function of a variable of the form bQ^^ Yl^=i ^jn + bn^Cin, where the com- 
ponents of are certain quadratic functions of central and boundary block 
variables. To handle the special structure of we employ a representa- 
tion theorem of Bradley (1983) for strongly mixing random variables and 
develop some iterated conditioning arguments to separate out the effects 
of the boundary block variables from the central ones. It is worth noting 
that typically, other versions of mean-corrected studentized statistic have 
a similar structure and, therefore, the arguments developed here may be 
of some independent interest in the context of studentization under weak 
dependence. The stronger version of the standard conditional Cramer's con- 
dition (i.e., the uniformity requirement over t € Bn) is a consequence of the 
iterated conditioning step in the proof. 

Verification of assumptions (A.3)-(A.6) requires choosing the auxiliary 
cT-fields fj's and the sequence dn suitably. Typically, the naive choice T>i = 
(T{Xi) is not the best to work with. As an illustration, we now consider the 
important special case where {Xjjjgz is a vector linear process and provide 
some simple sufficient conditions for (A.3)-(A.6). 

Proposition 2.1. Let 



where {Ai :i G Z} is a collection of nonrandom d x d matrices and {ei\i^z 
is a sequence of M.'^ -valued i.i.d. random vectors with Eei =0. Suppose that 
sup{\wkn\ :l < k < £,n > 1} < oo, lim„_>.oo fcn = 1 for each k>l, \\Ai\\ = 
0{exjp{—K\i\)) as \i\ — )■ oo, for some k G (0,1) and that A^o = Yliez^i 
nonsingular. Further, suppose that ei has a nonzero absolutely continuous 
component with respect to the Lebesgue measure on W^. Then, assumptions 
(A.3)-(A.6) hold. 



(2.5) 
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Now, we indicate how (A.3)-(A.6) are verified for tlie linear process case 
above. Under (2.5), we set Vj = cr{ej), j G Z. By the independence of the 
Ej's, assumptions (A. 4) and (A. 5) hold trivially. For (A. 3), we take xj^ = 

fL + J2\j\<m ^j^-i-j ' i £ Z,"T' > 1- Then, Xj^ is P*]'^^-measurable and in view 
of the exponential decay of \\Ai\\, (A. 3) holds. Verification of (A. 6) requires 
some additional work; see the proof of Proposition 2.1 in Section 6 for details. 

3. Main results. For describing the form of the EE and for stating the 
main results, we will introduce some notation and conventions at this point. 
Let Z+ = {0,1,2,...}. For a = (ai, . . . , a^)' G Z'f. and x = {xi, . . . ,Xd) 
set |q| = ai + • • • + ad, al = Y[k=i ^k, and x° = 0^=1 ^t'' ' ^^"^ denote 
the differential operator • • • where denotes ath-order partial 

derivative with respect to the ith coordinate of x. Write |/| to denote the 
size of a finite set /. For a collection of variables {^(A) : A G A} and for / C A, 
set A{I) = Yl^^jA{X) if / / and A{I) = 1 if / = 0. Unless otherwise 
stated, (i) limits in the order symbols are taken by letting n — )• oo and, 
(ii) the components of a vector indexed by the elements of the set Aq = 
{(p, g) :p, g G N, 1 < p < q < d} follow the lexicographic ordering. Let !(•) 
denote the indicator function. 

3.1. Definition of the EE. Using the smoothness of the function H , we 
can use Taylor's expansion to derive a stochastic expansion Ti„ (say) for 
Tn such that Ti„ is a polynomial function of certain vector-valued block- 
variables and such that the [s — 2)th-order EEs of r„ and Ti„ match up to 
an error of o{bn^^ ^^''^). In Section 6, we show that (a choice of) Tin is given 
by 

i=i l"l=j+i 

(3.1) 

s-2Vkis) *fc 3 

k=l j=0 \a\=j+l r=l 

where Z„ = ni/2(x„ - ^), = /i(/i)'[r(0) + ^Li ^knink) + r(A:)'}]/i(^), 
Ukis) = min{r G Z+ : n^'^'''+'^y^bn^^^{logn)'^''+'^y^ = 0((^n)}, and where {ci„(a)} 
and {c2n(a, I)} are some bounded sequences of real numbers, = (Afc„(A) : A G 
Aq), /c = 1,2,3 are certain di x 1 variables, as defined in (6.46), and sat- 
isfy ll^fcnll = Op{l). The sum ^**^ in (3.1) extends over all /= (Ii, 12,13) 
such that Ij C Aq, j = 1,2,3 and |7i| + 2|/2| + ^\h\ = k, 1 < k < s - 2. 
Let Xr^n denote the rth cumulant of Ti„, r G N (when it exists) and let 
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= Var(/i(/i)'Z„). Next, we expand the cumulants of Ti„ formally (i.e., 
assuming existence of all moments of the variables appearing in Tin) to get 

s-2 i'k(s) 

^r,n = E E K"'^^^''^Pt] + o{bn^'~'^") for 1 < r < r / 2, 
fc=0 j=0 



(3.2) 



s-2 ^kis) 



-^^.n = ^ + E E K"'n-^"pf!, + o{h-^^-'^'') for r = 2, 

''"in fc=o j=0 



where /3^^j = are real numbers satisfying = 0(1) for each j,k, 

with /Jq'^q ^ = for all n > 1 and r G {1, . . . , s}, and where z/o('5) = ^{s) — 2. 
Then define the polynomials 7Tj^k,ni') by the identity (in t G M) 



exp 



E 



{ity/rl 



\r=l lk=0 j=0 
s-2 i^fe(s) 

= 1 + E E b~J/'n~^/\,,W^t) + o(6-(^-2)/2), 

A;=0 i=o 

where vro,o,n(') =0 and for {j,k) / (0,0), the coefficients of Trj,k,n are func- 
tions of iS'j^j = /?^^]„'s and are bounded [i.e., 0(1) as n — oo]. (We show 

(r) 

the subscript n in Trj^k,n to highlight the dependence on j ^'s.) The den- 
sity tpg n of the {s — 2)th-order preliminary EE for T„, (with respect to the 
Lebesgue measure on M) is given by 



(3.3) rsJu) 



s-2 Uk{s) 



-k/2-j/2^ 



1 + E E ^n^'~^ ""'^jAn 



k=0 j=0 



d 

du 



u G 



where '/ro,o,n(') = 0, = T^/rf^ and (j)a{u) = a~^<j){u/a), u G M, a G (0, oo). 
Note that in (3.3), the approximating normal distribution is not A^(0, 1) but 
A^(0,e^). Therefore, setting = [e~^ — l]i we further expand the terms 
il^l n (u) involving the factor e„, to write 



(3.4) 



s-2i^k{s)rj,k('^) 

1 + EE E b~'^/'n~^/Wp^,J,kAu) 

k=0 j=0 i=0 

ips,ni'^) + 0{6n) (say) 



iu) + 0{5„ 



uniformly in u G M for some polynomials Pij^k,n{')'s with Po,o,o,n(") = 0, where 
Tj- fc(s) = niin{i G Z+ : bn''^^n~^/^an^'^^^ = o{bn^'~^''^^)}. The {s - 2)th-order 
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EE '^s,n for Tn is defined as 

/no 
'OO 

3.2. Main results. We are now ready to state the main result of this 
section. 

Theorem 3.1. Suppose that assumptions (A.1)-(A.6) hold. Then 
sup|P(r„ < n) - ^s,n{u)\ = 0(6;(^-2)/2(logn)-2) as n ^ oo. 

Theorem 3.1 estabHshes vaUdity of a general-order EE for the studentized 
statistic T„. From (3.4), it is clear that the EE in the dependent case has 
contributions from three sources, namely a series in powers of n~^/^ coming 

— 1/2 

from the estimation of 9 (by On), series in powers oi bn , coming from 
the stochastic error in estimating the asymptotic variance rf„ of and 
a third series in powers of , coming from the bias of the estimator f^. 
This should be compared with the relatively simpler form of the EE in the 
i.i.d. case [cf. (1-7)], where one is concerned with the estimation of finite- 
dimensional parameters only. In general, it is not possible to simplify the 
EE any further. Since the form of the EE is rather complicated, to provide 
further insight, we now provide an explicit expression for the third- order EE 
^s,n(0 with an error rate o(n~^) in Section 3.3 below. 

Remark 3.1. The arguments developed here can be easily adapted to 
establish valid EEs for studentized versions of a slightly more general class of 
estimators than that given by the smooth function model [cf. (1.3)]. Specif- 
ically, let On be an estimator of such that 

a{s) 

(3.5) n^/\0n -e) = iXn + Y.n-^/^Pkn{Xn) + 

k=l 

for some (nonrandom) 7 G M'* \ {0} and for some polynomials Pkn{') with 
bounded coefficients, where i2„ satisfies the negligibility condition: 

(3.6) P(|ii„|>C6;(«-2-«)) = 0(<5„) 

for some k G (0, 1). Under suitable smoothness conditions on the score func- 
tion V'(')) the M-estimators in (1.4) admit such a representation, and hence 
the EE techniques developed here can be readily applied to studentized M- 
estimators in (1.4). 
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3.3. Explicit expression for the third-order EE. To derive the explicit EE 
formula with an error of order o(n^^), note that under (A.l), the terms of 

order bn^^"^ , r > 4 are o(n~^). Hence, we restrict attention to the {s — 2)th- 
order EE for T„ with s = 5. For s = 5, the constants i^fc(s) in (3.1) are given 
by zv(s) = I'ois) = 2, z^i(s) = 1 and t'fc(s) = for A; = 2, 3. The explicit forms 
of the EEs for Tin can now be obtained by carrying out the steps (3.1)-(3.4). 
These steps involve long and tedious algebraic computations and are given 
in in Section 6.3. Here, we state the resulting formulae only. To that end, 
let -fffc(-) denote the /cth-order Hermite polynomial. A; > 0, defined by 

Hkix^ix) = {-!)'' ^cl){x), xeR. 



Proposition 3.2. Suppose that assumptions (A.1)-(A.6) of Section 2 
hold with s = 5 if i = 0{n^/^) and with s = 6 if i = 0(nV2-«). j^f^^^^ 
density of the preliminary EE tp^ [cf. (3.3)] for Tn with an error of order 
o{n~^) is given by 



(3.7) 



+ n-lg3„(x)+6-3/2g4„(x)], xGM, 



where the polynomials qm 's are as in (6.57). If, in addition, a^^ = 0{n ^^^), 
then 

sup|P(T„ < x) - ^„,,.(x)| = 0{n~\\ogny^), 
where, for x G M, 

^nA^) = ^(^) + 

(3.8) 



f X 


x^ 


[an 




+ {n- 





6al 



+ {bn'^P3n{x) + bn-^an^PAnix)} 

+ n~^p5n{x) + b~^^'^P6n{x) 



(f>{x), 



and where the coefficients of the polynomials pin 's are 0(1) as n — >• oo. The 
exact expressions forpin's are given in (6.58). 

Now, we discuss some of the implications of Proposition 3.2. The form 

— 1/2 

of the preliminary EE for r„ shows that the terms of order 6„ do not 
appear in the EE, as also are the terms of order As a result. 
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interactions between the n series and the -series show up only in 
the terms of order smaller than As a consequence, existing re- 

sults in the literature on second and third-order EEs for the studentized 
statistics fail to describe this interaction. Next, consider relation (3.8) which 
gives the explicit third-order EE for the studentized statistic T„, assuming 
= 0{n~^^^). For most commonly used weights WknS [cf. discussion of 
assumptions (A.l) and (A. 2), Section 2], the bias of the studentizing factor 
is 0(n~^/^), so that = 0{n~^/^), and hence, this additional condi- 
tion is not very restrictive. It is clear from (3.8) that it is the series, but 

— 1/2 

not the bn series, that may slow down the rate of Normal approximation 
to the distribution of T„ from the standard rate 0(n~^/^) observed in the 
i.i.d. case. Consequently, large sample confidence intervals for the parame- 
ter 9 based on T„ can have very poor coverage probability under dependence, 
unless the weights w^nS are chosen carefully to make the bias small. 

Remark 3.2. The explicit EE results of Proposition 3.2 can also be 
used to determine the optimal block size I for minimizing the error of Normal 
approximation to the distribution of the studentized statistic T^. Suppose 
that the weights w^nS in the definition of the studentizing factor in (1.5) 
is generated by a bounded taper function w : [0, 1] — )■ M as Wkn = w{k/t), 1 < 
k<l [cf. (2.4)], with w{Q+) = 1. Let r be the characteristic exponent oiw{-), 
i.e., r be the largest integer such that 

(3.9) «.(^) =. lim 

exists and is nonzero. Then, it can be shown that the bias of is of the 
order oii~^ and hence, = Cri~^{l + o{l)) as n — )• oo, for some constant Cr 
[involving the constant w^"^^ and derivatives of the spectral density function 
of the process {Z*}i^i where Z* = /i(//)'Xj]. From (3.8), it now follows that 
the rate of Normal approximation is optimized provided a^^ decays like 
n~^/^, which in turn implies that the optimal choice of the block size is of the 
order n^l^'^'^\ Thus, for the Bartlett lag-window, w{y) = (1 — y), y G [0, 1], we 
have r = 1 in (3.9) and the optimal block size is of the order n^/^. Similarly, 
for the studentization factor given by the Moving Block Bootstrap (MBB) 
method (cf. Section 4.2 below), the weights are asymptotically equivalent to 
those generated by the Bartlett lag-window and hence, the optimal choice 
of the block size here is also of the order n^l"^ . [Although assumption (A.l) 
rules out blocks of size n^/^ for a general-order EE, a second-order EE can 
be established for I = 0{n^^'^) with some additional work, which shows that 
these are indeed the optimal order for the case r = 1.] Next, consider the 
Daniell window, w{y) = and the Parzen window, w{y) = [1 — + 

62/^]l(0 <y< 1/2) + 2(1 - yfl{l/2 <y<l). For both of these, r = 2 and 
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hence, the optimal block size is of the order n^^^. Finally, consider the flat- 
top kernels of Politis and Romano (1995). For these, w^''^ =0 for all r > 1, 
and we have what are called the infinite- order windows. In such cases, under 
(A.1)-(A.5), the bias of decays exponentially fast, and the optimal order 
of £ is O(logn). 

4. EEs under alternative studentizations. In this section, we give results 
on general-order EEs for studentized statistics for various alternative choices 
of the studentizing factor that have been proposed in the literature. 

4.1. Lag covariance estimators with a different scaling. First, consider 
the effects of replacing Tn{k) by 

n— fc 

(4.1) fW(fe) = (n-A;)-i^(Xi-X„)(^i+fc-X)', 0<k<i, 

i=l 

i.e., we replace the scaling factor in r„ (A;) by (n-k)'^. Let 

rW = v^(^„-0)/fW, 

where fn^ is defined by replacing f.„(A:)'s in the definition of f„ by Fn^k), 
< k < i. In this case, the basic EE results of Section 3 readily yield EEs 
for ri^' . Note that 

e e 
f L'ko) + 5]^fcn(f L^kfe) + f L^kfc)0 = f n(0) + 5]tZ;fc„(f „(A:) + f „(fc)'), 

k=l k=l 

where Wkn = Wknin/in — k)], 1< k<£. Therefore, it follows that an {s — 2)th- 

order EE for Tn^ is valid under the same regularity conditions as those 
needed in the case ofTn with WknS replacing the WknS, and the correspond- 
ing EE is given by '^s,n{-), again with WknS replacing the Wkn's. 

4.2. Block bootstrap variance estimators. A popular approach to finding 
estimators of the standard error of 0„ is through one of the many block 
bootstrap and subsampling methods proposed in the literature [cf. Lahiri 
(2003)]. In this section, we consider higher-order expansions for the studen- 
tized statistic, when the studentizing factor is generated by different block re- 
sampling methods. Let i be an integer satisfying (A. 1) and let = n — ^ -|- 1 . 
Here, A'^ denotes the number of overlapping blocks of size i contained in 
{Xi,. . . , Xn}. For i = 1, . . . , A^, define Vi = Ylk^i^ Wkn{Xk - A„), where 
WknS are nonrandom weights satisfying X]fc=i^fcn ~ ^- Then, the block re- 
sampling estimator of Cov(Z„) (where Z„ = n^^'^[Xn — lA) is given by 

TV 

(4.2) s^^AT-^J^i/.y/. 

i=l 
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Note that for Wkn = this gives the MBB estimator of Cov(Z„) [Kiinsch 

(1989), Liu and Singh (1992)]. Due to the hnearity of the sample mean in the 
Xj's, with = ^"-^/^ is also the overlapping subsampling estimator 
of Cov(Z„) [cf. Politis and Romano (1994)]. Further, for suitable choices 
of WknS, gives the tapered block bootstrap estimator of Cov(Z„) [cf. 
Paparoditis and Politis (2001)]. 

With the block resampling estimator Sj^^ of Cov(Z„) given by (4.2), we 
now define the corresponding studentized version of 9n as 

where f}?^ = max{n-\ /i(X„)'[S^^]/i(X)}^/^. A general-order EE for T^^' 
continue to hold under regularity conditions similar to (A.1)-(A.6). To state 
the result, define 



(jiAn \ 
i=(j-i)^+i / 



(4.3) 

j = l,...,bon, 

where Uu = nN''^ Efct^"^ W(^k-i+i)n{Xk - A*), i = l,...,N and Uu = for 
i = N + 1, . . . ,n. Here and in the following, for a d x d matrix A = ((oij)), 
vec(j4) denotes the di = d[d + l)/2-dimensional vector, given by VEC(A) = 

[21 

(ail, • • • 1 Old; 022) • • • 1 o,2d'i • • • ; CLdd)' ■ The collection of random vectors {VFjJ : j = 

[21 

l,...,6on} gives the basic block variables for the studentized statistic TA 

» [21 

with the block resampling studentizing factor f„ . The following result gives 

[21 

the conditions for a valid (s — 2)th-order EE for Tn ■ 

Theorem 4.1. Suppose that assumption (A.1)-(A.6) hold with Wjn's 

[21 

replaced by W-^ 's. Then 

sup|P(T|2] <u)- ^fl{u)\ = 0{5n) asn^oo, 

[21 

where "^3,71 is obtained from the definition of^s,n by replacing Akn,k = 1,2,3 

^ [21 " [21 

with A^kn^k = 1,2,3 in (3.1) and where = 1,2,3 are as defined in 

(6.59). Further, for the linear process in (2.5), assumptions (A.3)-(A.6) 

[21 

[with Wjn = in (A. 6)/ continue to hold solely under the conditions of 
Proposition 2.1. 



4.3. Variance estimators without mean correction. In some limited appli- 
cations, one can assume that the mean ^ of the X\s is known. For example, 
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if the Xj's are univariate and one is interested in testing hypotheses of the 
form Hq : fj, = fiQ against Hi : fi^ fiQ for some given fiQ, it may be reasonable 
to use a studentizing factor without explicit estimation of the mean param- 
eter fi. In such situations, one would simply make use of the hypothesized 
value i^iQ of /.f to define a test-statistic. This often simplifies the proof and 
derivation of the EE for the studentized statistic. 

For the rest of this subsection, we suppose that fj, is known. Further, for 
notational simplicity, we set /i = (otherwise, replace Xi in each occurrence 
with Xi — fi). Then, each of the studentizing factors described above leads to 
a simpler form where the X„'s are dropped from the corresponding formulae 
for f„ s. As a specific case, we consider the known-mean version of the 
studentizing factor arising from fn , given by 



=max|n^\/i(X„)' 



N 



'li 

i=l 



1/2 



h{Xn) 



where, from above, Uu = nN ^ X^fctfi ^ ^(fc-i+i)n^A:) i = 1, ■ ■ ■ , N and Uii = 

for i = iV + 1, . . . , n. Set T^^' = ^^(4 - 0) /f|' . Then we have the following 
result. 

Theorem 4.2. Suppose that assumption (A.1)-(A.5) hold with Wjn's 
replaced by VFjJ [cf. (4-3)], and the following weaker version of (A. 6) holds: 

(A. 6)' There exists a constant k G (0,1) and a sequence {dn} C [l,oo) with 
dn = 0{£) and d^ = 0{bl^'^) such that for all n > kT^ and < m < 
[log n]^/'', 

(4.4) max sup ii;|i?{exp(.t'[M^g + • • • + W^(!^+^)J)|^,„}| < 1 - 

where Jn, Bn, and Dj^ are as in (A. 6). Then 

sup|P(r^3l <u)- ^'il('u)| = 0{6n) as 00, 

where ^'s,n is obtained from the definition of '^s,n by replacing A^ni^ = 
1,2,3 with = 1,2,3 in (3.1) and where if] = ifj, with if] as in 

^ [31 

(6.59), and where A^^ = for k = 2,3. Further, for the linear process in 

(2.5) , assumptions (A.3)-(A.5) and (A. 6)' hold solely under the conditions 
of Proposition 2. 1 . 

[31 

Note that Theorem 4.2 gives a valid EE for Tn under a slightly weaker 
conditional Cramer condition (where -Esupjg^^ | • | is replaced by supjg^^ E\ ■ 
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I ) . This is a consequence of not using an explicit mean correction in the stu- 

- [31 

dentizing factor fA . In this case, vahd EE can be derived by combining the 
EE results of [L] for sums of block variables and the transformation technique 
of Bhattacharya and Ghosh (1978). No iterated conditioning arguments, like 
those used in the proof of Theorem 3.1 (cf. Section 5 below) are needed. Ve- 
lasco and Robinson (2001) proved a third-order EE for a mean-uncorrected 
version of the studentized statistic, for Gaussian processes. Theorem 4.2 sup- 
plements their results by dropping the Gaussianity requirement and giving 
a general-order EE, under regularity conditions (A.1)-(A.5) and (A. 6)'. 

5. Edgeworth expansions for perturbed sums of block variables. It can 

be shown (cf. Section 6) that the basic building block in the stochastic 
approximation to the studentized statistics r„ is given by a perturbed sum 
of block variables of the form: 

(5.1) K= (n'/'K,^^pK + b-'e}j , 

where, Yi^s are as in Section 2 and is a quadratic form in and 
the boundary blocks of length i [cf. (6.2) below]. As a result, for deriving 
the EEs in Section 4, we need to develop an EE theory for i?* , which we 
address in this section. 

Note that the second term in i?* has a nonstandard form which gives rise 
to some difficult technical issues that must be resolved for deriving valid 
EEs for such a statistic. Specifically, note that with d = 1 (for notational 
convenience), f„ is a variable of the form 

where sWjn, j = 1, ^on are certain boundary block variables (based on blocks 
of size i) that are asymptotically normal. Although it may appear reason- 
able at the first glance, deriving an EE for i?* from the joint distribution 
of n^/'^Xn, Y^i=i Yin and ^Wjn, j = 1, 6on is not very useful for our pur- 
pose, as the EEs for sWjn, j = l,fton are in powers of which can 

be too slow to give an overall error rate of o{bn^^ ^'*^^)) particularly when 
£~ (logn)*^. This observation leads us to consider finding an EE for ^„ 
directly. But by taking the direct approach, we have to contend with a 
complication that arises from the fact that the boundary block variables, 
being common multipliers of all the Xj's in v}/'^Xn, induce strong depen- 
dence of among the product variables. To deal with this, here we develop 
a conditioning argument with resect to suitable initial and end segments of 
the variables Xi, . . . ,X„ and derive a valid EE for the joint distribution of 
n^/^X„ and Y^i=i ^in + bn^Cn- A representation result of Bradley (1983) 
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(cf. Lemma 6.1 below) for strongly mixing random variables plays a crucial 
role in carrying out the conditioning step in the proof. 

Next, we define the {s — 2)th-order EE Tg^ni') for i?* through its Fourier 
transform t^,„(t) = J exp{Lt'x)T{dx), t e M"^". Let S^n\t) = t'R*^, t G M-^o. 

Note that ES^n\t) = b'^^^t'ECin and Var(si°'(t)) = t'Ent + 2bn^^^t' ESnC'iJ + 
h~'^t' E^ini'int, where = (0' :Cn)'- Also, by Lemma 6.3, for 3 < r < s, the 
rth-order cumulant [cf. (6.4)] of Sn\t) is 

|ai| = l |ar|=l 



\a\=r \j=0 J 



for some constants A^'^^ G M, with A^"^^ = 0(1) for all j and a. Next, define 
the EE polynomials {^r.n^; : r = 1, . . . , s — 2} by the identity: 

exp[ 6-3/2 _ £ESn^^^t\ - ^-i^t'Eini'mt 



-{r-2)/2 



E (^*)' 



r=3 
s-2 



|a|=r 



J=0 



l + Y.h-^l\r,n{^t)+o{bt^'^/^). 



r=l 



The Fourier transform Ts.„ of Ts^„(-) is defined as 



Ts,n(t) = exp(-t'H„t/2) 



s-2 



r=l 



With this, we now have the main result of this section. 

Theorem 5.1. Let i2* he as defined in (5.1). Then under assumptions 
(A.1)-(A.6), 

(5.2) sup|P(K (iB)- Ts,nm = 0(6;(^-2)/2[i^g^]-2)^ 

where B is a class of Borel subsets of M*^" satisfying 

sup<^E{[dBY) = 0{e) aseiO. 
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6. Proofs. For clarity of exposition, we shall switch the order of proofs 
of the results from Sections 2, 3 and 4 and those from Section 5. In Section 
6.1, we set forth some common notation and state some relevant facts that 
are used in the rest of the section. The proof of Theorem 5.1 for a general 
d > 1 and various intermediate steps (cf. Lemmas 6.1-6.6) are presented 
in Section 6.2. Proofs of the results from Sections 2, 3 and 4 are given in 
Sections 6.3-6.5, respectively. 

6.1. Notation and preliminaries. With a given d> 1, let d^ = di + d, 
where di = d{d + l) /2. Thus, do is the dimension of the block variables WjnS 
in (2.2). For a d x d matrix A = ((ajj)), let VEC(A) be the di -dimensional 
vector, consisting of the on- and above-the-diagonal entries of A (with the 
lexicographic ordering). Let SVEC(j4) =vec{A) + vec{A'). Next, define the 
reverse operation vec~^(-) from M^" into the class of d x d matrices by 
setting 

[vEc~^{x)]ij = e {{i,j) e Ao). 

Thus, vec~^(2;) is an upper triangular matrix with the elements from x 
filling in the on- and above-the-diagonal positions and with zeros below 
the diagonal. Also, set SVEC~^(x) = VEC~^(x) + [vEC~^(x)]'. Note that for 

t£R^o and x,y£W^, 

t'vEC{xy') = x'[vEC~^ {t)]y, 
(6.1) t' SVEC{xy') = x'[svEC^^{t)]y and 

||SVEC"^(t)x|| < C(d)||t||||x||. 

Here and in the proofs below, let C, C(-) denote generic constants in (0,oo), 
depending on their arguments (if any), but not on n and i. For notational 
simplicity, we will suppress the dependence of C,C{-) on the dimension 
variables do,di and d and the constant k appearing in assumptions (A.l)- 
(A.6). Let ei, . . . , denote the standard basis of M'^. Let tp : [0, oo) — >• [0, oo) 
be an infinitely differentiable nondecreasing function satisfying ^l^{u) = u for 
< M < 1 and il}{u) = 2 for u > 2. For c > 0, define the truncation function 
g{--c)-M^ ^mJ" (for a /cGN) by 

{cx , ( ||x|| \ 
0, if X = 0. 

Thus, g{x;c) = x for ||x|| < c and ||g(x;c)|| < 2c for all x € M*^. For n>l, 
set c„ = 6y^(log(n + 1))~^ and let 6n,c = bn^^ ^^''^(log[n + 1])"*"^ for some 
C £ (0,oo). Note that 

— '5r!,,2(l + o(l)) . For a Sequence of random variables 
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{Wn}n>i and a sequence real numbers {xn}n>i £ (0,oo), we write Wn = 
dp{xn) if 

P{\Wn\>Cxn) = 0{6n) for some C7 > 0. 

For notational simplicity, we will often drop the subscript n and write 6„ = b, 
bon = bo, in = i, etc., whenever this convention does not create confusion. 
Also, unless otherwise stated, we set ij, = in all of the steps below. Thus, the 
X-variables appearing in the expressions below are centered; in particular, 
Xn = Op{n-y^). 

Let Wjn = (iWj'n' sW^jn)') where iWjn is d x 1. Similarly, partition 5.„ = 
bn'^^T.'=iWjn as Sn = {A2S'J. Let 

(6.2) U = n^^^ SVEC(X„[3T^l„ + 3Wb,n]'), 

where 3Win = i-^^^EUiiEi=iWkn)X, and aP^bon = ^"'Z' Etl(EL^ «^fcn) x 
Xn^i+i- Also, with sWjn = for j = 2, . . . , 6on - 1, set 

W^Jn = ilW^n, 2W;n, 3W;j, J = 1, . . . , bon- 

Unless otherwise indicated, a check (") and a tilde (~) on a random vector 
(at stage n in the asymptotic argument) denote its truncated version (at Cn) 
and its centered truncated version, respectively. Thus, rWjn = girWjn',Cn) 
and rWjn = rWjn — ErWjn for r = 1, 2, 3 and j = 1, . . . ,bo. Next (with a 
slight abuse of the above notation), define Wj^ and Wj^ by replacing 
{rWjn-r = 1,2,3} with {rWjn-r = 1,2,3} and {rWjn'-r = 1,2,3} , respec- 

tively. Set In = SVEC(i5„[3M/^i„ + sWh^^n]') and S^^\t) = t' Sn + ftn'^'i'lm, 
with iin = (OM;)' G M'^o. Note that for t = {t[,t'2y e M'^ x M^o, 

S^n^ (.t) = b-'/'^it'Wjn + b-'/'isWin + 3^^^feo„n)' [SVEC-^ (ia)] (l W^n)] 

(6.3) 

bon 

^bn'^'^Vjnit), say 

Next, for an integrable random variable V on (i},J^,P), define 
EtV=[HlSt)r'E[VeMS^nHm, teR''', 

where Hl^\t) = ^exp(t[5l°^ (t)]), t G M"^". Also, let F„(i) = E exp{it' Sn), t G M*^. 
Define the semi-invariants icf^ {Vi , Vp) in variables Vi, . . . ,Vp on {Q,, T, P) , 
by 

cPlcf\Vi,...,Vp) 
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d d 



X logSexp(it'S[,°l + ^ei^i + • • • + EpVp]), t G 
Then, it is a well-known fact that (cf. (3.13) of [GH]) 

(6.5) /cfi(yi,...,yp)=x;Ec(/i,...,/,)ni^<n^^' 

j=l 1=1 k£li 

where ^* extends over all disjoint unions /i U • • • U /j = {1, . . . ,p} and where 
c(/i, . . . , /j)'s are combinatorial coefficients. Also, for any nonempty and 
disjoint decomposition of {l,...,p} into the sets Ji and J2, one has (cf. 
(3.14) of [GH]), 



(6.6) 



i=l i=l ^ k&In ^ ^ fc6/i2 ^ 



where Jjr = /i H J^-, 1 < i < j, r = 1, 2. 

Next, write /cf' (Vf^, V^"^) = JCf^ (Fi, . . . , Fi, Fa, • • • , 1^2) where, on the right- 
hand side, Vi appears p-times and V2 appears q times. Expanding logHn\t) 
in the Taylor's series, one has 

s 

(6.7) logi/M(i) = Y.i'XS\[S^Ht)r) + Rn{t), 

r=2 

where Rn{t) = [/^(l - r/)^.^+i/Cg ([sj?' (t)]o(^+i)) dr^J/s!. 

6.2. Proof of the main result from Section 5. Before proving Theorem 
5.1, we state and prove some of the intermediate steps in its proof as lemmas. 
The first lemma is a variant of Bradley (1983)'s result on representation of 
strongly mixing random variables that plays a crucial role in the rest of the 
proof. 

Lemma 6.1. Let X be a r-random vector and let Y = (yi,...,!^)' he 
a k-random vector on a probability space with \\Y\\y < 00 and with oq = 
a{a{X),a{Y)), where 7 G (0,oo) and k,r £N. Then there exist a k-random 
vector Y* (on a possibly enlarged probability space) such that (i) Y and Y* 
have the same probability distribution on M^, (ii) X and Y* are independent 
and (iii) for all t G (0, minj=i^...^fc 11^117]; 



P( max \Yj -Y*\>t] <l8k(al ma^ \\Yj\\^-t^^ 



7/(2+7) 
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Proof. For k = 1, this is a restatement of Theorem 3 of Bradley (1983). 
For k>2, one can use finite subadditivity and apply Bradley (1983) 's result 
term-wise to get (6.8). □ 

Lemma 6.2. Let Zi, . . . , Zm be random vectors (of dimensions ki, . . . , km G 
N, respectively) on a probability space with E\\Zi\\'~' < oo for some j £ {0,oo). 
Let aoj = a{a{Zj) ,a{Zj+i, . . . , Z^)) for j = 1, . . . , m — 1. Then there exist in- 
dependent random vectors {Zi,...,Z^} (on a possibly enlarged probability 
space) such that (i) Zj and Z^ have the same probability distribution on M.^^ , 
j = 1, . . . ,m, (ii) Zm = Z^, and (iii) for all j = 1, . . . ,m — 1, and t £ (0, toj], 

max \Zji — Z*^\ > tj < ISkjla^j max ||Zjj||^ • j , 

where tQj = Tcim.\)\Zji\^:i = \^. .. ^kj\, and Zji,i = 1, . . . ,kj are the compo- 
nents of Zj . 

Proof. First, take Y = Zi and X = (Zg, . . . , Z'^)' in Lemma 6.1 to get 
a copy Zj* of Zi that is independent of {Z2, . . . , Zm} and that satisfies (6.9) 
with 3 = 1. Next, set Y = Z2 and X = (Z3, . . . , Z'^; Zj*')' in Lemma 6.1. Using 
the independence of Z\ and Z2, . . . , Z^, it is easy to check that 

a{a{Y) , a{X)) = sup|P(Z2 G A, X G S) - P(Z2 G A)P{X G B)\ 

A,B 

< E(snp\P.\z*=z, (Z2 G A, (Z^, . . . , Z'm,ziy G B) 

- P(Z2 G A)P.|zr=., ((^3> ■■■,Z'^;z^y€ B) 
<aoj. 

Hence, by Lemma 6.1, there exists a copy Z| of Z2 that is independent of 
X = (Z3, . . . , Z^; ZJ"')' and that satisfies (6.9) with j = 2. Now repeat this 
process (m — l)-times to get independent variables Z^, . . . , Zj^_^ satisfying 

(6.9) that are all independent of Zm- Finally, set Z^ = Zm to complete the 
proof of the lemma. □ 

Remark 6.1. Note that in Lemma 6.2, the bound in (6.9) involves the 
dimensions of the first (m — 1) vectors only, but not the dimension of Zm- 

Lemma 6.3. Suppose that assumptions (A.l)(i) and (A.2)-(A.5) hold. 
Then, for any 2 <r < s ai, . . . , a,. G M'^o with \\aj\\ < 1, j = 1, . . . ,r, 

(6.10) /Co(^M(ai), ■ ■ ■ , ^^(a,)) < C6;('^"2)/2^ 
uniformly in ai, . . . , a,. G M'^" with \\aj || < 1, j = 1, . . . , r. 
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Proof. Fix 2<r < s and ai,...,ar G R'^° with ||aj|| < 1. Let Sr = 
min{[(s - 2)/3j,r}. Note that for r > [(s - 2)/3j , 6,7^^''-+^^/^ = o{bn^'~^^^^). 
Also, note that for any random variables Vi, . . . ,Vr, 

r 

|/Co(yi,...,V;)|<C(r)n{^ll^iir}'/'' and EfSn\Y + E\\l^n\Y = 0{l). 
Hence, using the multilinearity property of the semiinvariants, we have 

/Co(5ra(«i),---,5MK)) 

r 

J=0/c{l,...,r},|/|=i 
i=0 7c{l,...,r},|/|=j 

By Lemma 4.1(ii) of [L], the j = term is 0(6n''' ^'^^) mider assumptions 
(A.l)(i) and (A.2)-(A.5). Hence, consider 1< j <r and fix an / G {1, •••,?'} 

with |/| = j. Then bn^^ ^'^\K,o{{a'^Sn '■ i G /'^}; {a'jfin : ^ G /})| is bounded above 
by a sum of finitely many terms of the form 

(6.11) b-^^/^\fCoi{a'X-i^ n;{[3Wln + 3Wbo„nr[lSnf'-i(^ ^})l, 

where \ai\ = 1 = |/3j| for all i G /. To derive an upper bound on these terms, 
we make use of some known results on the cumulants of polynomial functions 
of a given set of random variables, for example, as given in Brillinger (1981). 
Consider the two-dimensional array 

(1,1) (1,2) 
(2,1) (2,2) 

(6.12) (i,l) (i,2) 

(i + 1,1) 

(r,l) 

and a partition Pi U • • • U Pm of its entries. Following Brillinger (1981), we 
say that the sets and Pi of the partition hook if there exist (ii, ji) G Pk 
and (12,^2) G Pi with ii = Z2 and we say that Pk and Pi communicate if there 
exists a sequence of sets Pk^ = Pk , Pk2 , • • • , Pk^ = Pi from the partition such 
that Pk- and Pki_^_i hook for all i. A partition is said to be indecomposable 
if all sets in the partition communicate. Then, for any collection of random 
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variables {Xp^q}^s, indexed by the elements in the array (6.12), Theorem 
2.3.2 of Brillinger (1981) yields 



(6.13) 




Xi^k : i = 1, . . . , j > ; {Xi^i :i = j + 1, . . . ,r} 



k=l 



5^/Co({Xp,g : {p,q) G Pi}) • ■■JCoiiXp^g : {p,q) G Pm}), 



where the sum ^* above extends over all indecomposable partitions Pi U 
• • • U Pa/ of the array (6.12). Note that if a partition of (6.12) is indecompos- 
able, then all elements from the last (r — j) rows must belong to a single set 
in the partition. W.l.g., we suppose that Pi contains all the elements from 
these rows, i.e., {{i, 1) : i = j + 1, . . . ,r} C Pi. Thus, by (6.11) and (6.13), it 
is now enough to obtain a bound on terms of the form 

(6.14) {a'^AiSn] : i G Pu}; {a'^A : i G Pis}) 

M 
k=2 

for nonrandom vectors Opj's, x^i's and ytiS with vector- norm less than or 
equal to 1, and for indecomposable partitions Pi U • • • U Pm of (6.12), where 
Pi = Pii U Pi2 U Pi3 with |Pi3| = r - j and Pfc = Pfci U Pfcs for /c = 2, . . . , M. 
Further, X^^2 l-^^l ~^ \ + 1-^121} = 2j, the total number of terms in the 
first j rows and 'Yl,k=i Wki \ = j, the total number of [sTVin + 3^60^"] terms 
in (6.11), and |Pfc| > 2 for all = 2, . . . , M. Under (A.2)-(A.5), by arguments 
in the proof of Lemma 4.1 of [L], 

I^0({a'ij3^^1n + 3Wbo„n] ■ i G P\\\\ 

(6.15) {a'2ji5„] :i G P12}; {ag.S^ : i G Pia})! 

= o(6;;[i^i2i+i^i3i-2]/2^ 

and for A; = 2,..., M, 
(6.16) 

= 0(6;;(l^-l-2)+/2). 

Hence, it follows that the product in (6.14) is Oihl^^''^ x 5-[I-Pi2|+I-Pi3|-2]/2 ^ 

nfcl2^"^'^'''~^^^^^)- Using the conditions on Pfcp's, it can be shown that 
the largest order of these terms is attained when \Ph\ =2 for at most 
[(2j — l)/2j-many fc's and |Pi| G {r — j + 1, r — j + 2} (so that Pi contains 
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either one or two elements from the first j rows). (The term corresponding 
to "|Pi| = r — j + 1 and \Pk\ =2 for all k > 2" actually does not appear 
in the sum ^* due to the indecomposability condition.) Thus, the product 
in (6.14) is 0{h~^^''^ X h~^''~^~'^'^''^) = o{h~^'"~'^^'^) for all j = 1, . . . ,5^. This 
completes the proof of the lemma. □ 

For the next lemma, set Vn{I) = Ilje/ np=i ^"('^ip) 

and Wn{I) = 

Wj&iW%i a'jpWjn, / C {1, . . . , 6„} where ajp G M'^'o with \\ajp\\ < 1, rj G N. 
Also, for r > 0, m > 3, and J C {1, . . . , 6on}, let 

Hn,j{t) = E exp ( it' Wjn ) and 

4^) = 5i^)(i;m) = .6;V2 5:VS„(i), 

t G , where Jr = {j ■ \ j — i\ > "nr for all i G J}. 

Lemma 6.4. Let / C {1, . . . , 6on} with 1 < |/| < s + (io + 2 and diam(/) < 
mi /or some 1 < mi < C[logn]^. // assumptions (A.l)(i) and (A.2)-(A.5) 
hold, then 

(6.18) \EtVn{I)\ < C[E\Wn{I)\ ■ \9nAt)\ + 2-^]|i/^l(i)r' 

for all \\t\\ < Bin, where ei„ = [log n log log n] , K = Kn = [(logn)^/^] and 
6n,i{t) = suv{\Hn,j{t + {x'svEC-\t2),0j)\:\\x\\ < 2c„/6^/^ J G Jn}, with 
Jn being the collection of all subsets of {1, . . . , 6on} \I of size greater than 
[bon — mi — {K + l)m] , m = 3 \K log log n] + 1 . 

Proof. Let mon = [i^ log log n]. Then, the following three cases are 
possible: 

(I) /n{ir""/0; (II) /n{6onr""/0; 

(III) /n[{ir°"u{5o„r«"]=0, 

where {j}™ = {i:\i — j\ < m}. We begin with case I. Note that in this 
case, / C {1, . . . ,mon + mi + 1}. With J = {1, . . . ,mon + + 1} U 
and m = 3mon + 1, define Ai^^ = [exp(/S'j — Sj^) — l],r > 1 and Vin{J) = 
Vn{I) exp(t6„~^/^ SjeJ ^jnit))- Then using the iterative method of Tikhomirov 
(1980) as applied in the proof of Lemma 3.16 of [GH], one can show that 

\H^^\t)\\EtVM)\ = \E[Vin{J)eMsT)]\ 
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(6.19) 



K 
r=l 

+ 



\j=l 
K 



exp(5i^); 



exp(5f); 



Note that for any 1 < jo < 3i < the variables {W"jJ '-j < Jo} and {l^jj '-j > 
ji} are functions {Xj : j < jqI + f\ and {Xj : j > jii + 1}, respectively. Now, 
approximating Xj^s by Xj^^Js, we see that the corresponding variables 

{W'j^'^ij < jo} and >ii} are measurable with respect to the a- 



fields V- 



'^■1+^+-- and 



^, respectively. Next, approximate the vari- 
Lsing Xj^m^Js; call the approximating vari- 
ables V^^{J) A|^'s and Sj'^^s, respectively. Then, by (A. 4), the a-mixing 

(and also, that between 
1)1 — 2mon]))- Hence, the 



ables Vin{J), ^i.j's and Sj s using Xj^rnoJs; call the approximating varl 

'^t f n At >^ cWt 

co-efficient between (t({A|j}) and a{{A\ ^^2}) (and also, that between 

(T{{A\ j}) and (7({Sy+^^^})) is 0(exp(-K x [(m - 
last term in (6.19) is bounded above by 



.20) 



E\V{I)\ll\A^,\2^/' 



r.2^/^E{\[ |aI + 0«"i^2^/2exp(-K • mo„)). 



where ro = X^jg/ and where W extends over all even indices j G {1, . . . , K}. 
Next, note that by (A. 2) and Lemma 6.2, there exist independent random 
vectors W^J?, w]^^*^, and {wf}* : j ^ {1}- U {6on}™} ^ {^^^'f : J ^ {1}" U 
{feon}™} such that with u 

P 



.21) 



exp(— Kmon 

< C{d){u-'^ exp(-K[(m - 1) 
= 0(exp(-C(K)mon^)) 



2mon])E\\wjf\\)'/' 



for j G {l,6o„}. Next, define A^^^ by replacing W^f's in A|^^, with VFj^^^'s. 
Note that for any function / : M'^o x M'' C (/c G N) with \ f{x; z) - f{y; z)\ < 
Ci||x-y|| and |/(x;z)| < Ci for ah x G R'^f ,2 G M'' and for some Ci G (0,oo), 

sup|/(W;,[f;z)-/(iy,!f ;z)| 



.t 



zeif 



^sup{|/(Ty,[f;z)-/(H^? 



;2 l( 
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(6.22) + ;z) - fiwlf;z)\U\\wlT - I^^If || > n.)} 

< Ciun + CiPdlll^Jf - W]f\\ > n„) 

< Ci [C{d, k) exp(-C(K)mo„^)] 

for j G {1, 6on}- Thus, by two applications of (6.22), we have E\A[ ^ — A* ^| = 
0(ei„ exp(— C(K)mon^)) uniformly in t G Bin = {x- \\x\\ < ein} and in r G 
{1, . . . ,K}. Hence, using the independence of the w[^* and W^iJj'J*^ with the 

rest of the VFj|^^*'s, the arguments in the proof of Lemma 3.16 of [GH] (for 
the second inequality below) and the above bound, uniformly in t G Bin, we 
have 



|The last term in (6.19)| 

<c;«2^/2i^(niAi';i*i) 

+ OiCeinK2^^^[exp{-CiK)moni) + exp(-Kmon)]) 
(6.23) =c;o2^/2i?|i?(n|A[°lni^Jf,<;;)}+0(exp(-C7(.)mo„)) 

<c-2^/2i?|^i^(lAM*||^l^fJ^ <;;„)} 

+ 0(exp(-C(K)mon)) 

< C2^V2p(||s||)p||^i/25-i/2]i^/2 ^ o(exp(-C(K)mo„)) 

< C{ro, ||S||)2-^ + 0(exp(-C7(K)mon)), 



where in the last inequality, with Jr = {j '-{j — i\ > mr for all i G J}, we have 
used the bound 



E{\AZ*\\WlTMZn) 



E 



(6.24) 



j&Jr-l\J, 



[0]t 



+ bn^/^CnE 

< \\t\\bn'/'cm\)m'/'. 



[0]t 
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Next, consider the rth summand in the first term in (6.19) (1 < K). Note 
that 

j&Jr j&Jr 

where t = [t'^^t'^' with t2 G M^". Use Lemma 6.2 to construct indepen- 
dent copies of the random vectors : J < rn^n + 'mi + 1 + (r — l)?7i}, 
{^l^jf : 6on - (r - l)m < j < 6on}, and {W^jf : mo„ + ?ni + 1 + (r?n + 1) < 
i ^ bon — {f"m + 1)}. Then approximating W'j|j^''s with W"j^^^'s first and then 

^jn^'s with their independent copies W^^^*^s and using (6.21) and (6.22), 
uniformly in t G Bin, we get 



K 

E 

r=l 



EVin{J) 



exp(S' 



(r)^ 



E 



i5^vi;(j)(^nA^,^.j exp(5; 



(r)*N 
J ' 



+ 0(c^°ao„K^2^[exp(-C(K)mo„^) + exp(-K • mo„)]) 



E 

r=l 



\j=l 



i?{exp(5i^>)|^S*,<tj 



(6.25) 



< 



+ 0(exp(-C(K)mo„)) 

iC /r-l \ 

r=l \j=l / 



X sup |if„,j,(t+(0',x'sVEC-^(t2))')l 
||x||<2c„/6„ 

+ 0(exp(-C(K;)mon)). 

Next, deleting the odd-j terms in the product as in (6.20), using the weak 
dependence of the alternate sums as in (6.23), and the bound (6.24), one 
can show that uniformly over t G -Bin, 



K 



E^ 



r=l 



/r-1 



\j=l 



K 



<CE\V:{I)\Y,'^^/\Cm\)\\t\\rn}''h~'/'\ 



r/2 
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(6.26) 

+ 0(exp(-C(K)mo„)) 

< CE\V*{I)\ + 0(exp(-C(K)mon)). 

By (6.23), (6.25), (6.26), Lemma 6.4 is proved for case I. 

The proofs of cases II and III are similar, with the set J in the two 
cases now to be chosen as J = {1} U {6on — fnon — f^i-, ■ ■ ■■, ^On} and J = 
/ U {1} U {6on}, respectively. We omit the routine details. □ 

Lemma 6.5. Suppose that (A.1)-(A.5) hold. Let /i, /2, C {1, . . . , 6} with 
min{l2} — max{/i} > mi for some integer C[logn]^ < mi < bon ~ ~ |-^2| • 
Then there exists a constant C{^) € (0, oo) such that for all \\t\\ < ei„, and 
n>l, 

(6.27) \EtVn{h)Vnil2) - EtVn{h)EtVn{h)\ < (^(7)2"^ '^k*) 1"' , 

where the variables Vn{Ik) 's are as defined above Lemma 5.4, 7 = Yl'k=i "l^jei^. ^i? 
and K= [(logn)3/2]. 



Proof. Let {WjJ** : j = 1, . . . , ^on} be an independent copy of {W'jJ : 
j = 1,. . . , bQn} and for a random vector U = f{Wj^ : j = 1, . . . , &on) , let U** 



/(^in** -i = 1) • • • ) ^On)- Let io = min{/2}. Define the variables Ui = Vn{Ii, 



Vrih), U2 = Vn{l2)U'%o^M'^bJ^^l^jn{t) + Vjnit)**]) and U3 = 

— 1/2 ~ 

ni<j<2o ^'^Pi^bn [Vjui't) + Vj^ni'^)])- Then it is easy to check that 

\Hj^\t)f X \EtVn{Il)Vn{l2) - EtVn{h)EtVn{l2)\ = \EUiU2U3\. 

Like in (6.17), write 5„(r) = ib^^^^ Ei<j<io-mr[^in + V^/„*], A2,. = [exp([5„(r- 
1) — Sn{r)]) — 1], < r < K . Then, using Tikhomirov (1980)'s iterative 
method as in (6.19) (see also. Lemma 3.1 of [L] and Lemma 3.17 of [GH]), 
we get 

EU1U2U3 = J2eI^UiU2 exp(5„(r))| 
(6.28) ^"^ 



+ E{ U1U2 



|^nA2,,^ exp(5„(i^))|. 



Let mon = [log n log log n] and let Wj^^l^ be the [2(io] x 1 random vector with 
components Wj^\^^^^ and W^jnmon' i = l'---'^On- Next, consider the rth 
term in the sum in (6.28), 1 < r < K. Note that by (A. 4), the strong mixing 
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coefficient between the variables { W^*^^ rnr} and { W^*^^ -j^io — 

m{r — 1)} is bounded above by 2k~^ exp(— ^[(m — 1)^ — 2mon])- Hence, using 
(A.2)(ii) and Lemma 5.2, we can construct independent copies {W^*^* :j < 

— mr^ and {W^*^* ■j'>io — m{r — 1)} of these two sets of variables such 
that [cf. (6.21)] 

P( max ||W™*-W;°|t||>n„ 

(6.29) <nC(d)(^z;iexp(-K[(m- l)£-2moJ)i?||VF]f 11)^/2 

= 0(exp(— C(K)mon/^)). 
Hence, with the "natural" definition of the relevant and [•]*-variables 

(defined in terms of W^'^^'s and W^'^*'s, respectively), uniformly in 1 < r < 
K and t G -Bin, we have 

^|?7iC/2^nA2,,^ exp(5„(r))| 

= e\ij\\J\ (^h 4,,-^ exp(5t(r))| + 0(c;^i^2^exp(-A^ • mo„)) 

= e\uI\Ji{^^Ai}\^ exp(5:(r))| 

+ 0(c;^i^2^[exp(-K • mo„) + exp(-C(K)mo„^)]) 

e{iJIUI ^2,,^ exp(5:(r))|{W;°|* : i >i^-\t- l]m} 

+ 0(exp(-C(K)mon)) 

= 0(exp(-C(K)mon)), 

since the conditional expectation in the first term is zero due to (i) the 
definition of t/f and (ii) the symmetry of C^i*t^|[nj=i ^2 j] 6^P('S'n('')) in 
the two do 1 components of W*^^ for all j. Next, using arguments 

similar to the proof of (6.23), one can show that the last term in (6.28) is 
0(exp(— C(K)mon))- Hence, (6.27) follows. □ 

Lemma 6.6. Suppose that assumptions (A.1)-(A.5) hold. Then, for any 
/ C {1, . . . , bon} with \I\ < C , and for any 3 < m < bon/C, there exists L > 
C[b/m] such that 

|i/M(t)||EtK(/)|<C7c;^[/3i„(t)]^-2 + C(|/|)Lc;^[l + ||t||Mexp(-C(At)m£) 



■■E 
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for all t G where = max{^|E(exp(i6;^/^ E|i-io|<m ^jn(t))|:Pjo)l : 

m < jo < b — m}, 7 = Ylji^i'^'j '^^^ ^jo ^-^ '^•^ assumption (C.6). Further, 

f6 30l /3 /,^< fexp(-Acm||t||V[86„]), M ||t|| < Cbjm^, 

^ ' ' ^'"^ ^ - I exp(-C(K)(d„6y')-2||t||2), /or aZZ ||t|| < 2^6^'^,. 

Proof. Let / = {ji, . . . , >}, Jon = {l,---,&On}, and Jin = {j G Jon : I j - 
ifcl ^ 2m + 1 for all 1 < A; < r}. Next, define the indices ji,j2, • • • by 

ji = inf Ji„, 

jp+i = inf{j G Ji„ : j > jp + 7m}, p = 1, 2, . . . , L - 1, 

where L is the first integer p for which the infimum is taken over an empty 
set. Then, it follows from the definitions of j^, • • • , that: 

(i) [(6on - r(2m))/7mj < K < [feon/7?n], 
(fi) [jO - m, + m] C Jon,P = 2,...,K-1, 
(hi) > j° + 7m, p = 1, . . . , /C, and 

(iv) (/rn{i?,...,i^} = 0, 

where (J)"^ = {j E Jon: there exists i € I with |j — i| < m}. Next, define the 
variables Ap,Bp,p = 2, . . . ,L — 1 and the variable R by 



Ap = expK6;i/2 ^ 



i?p = exp('.6;i/2 ^ Vjn{t)\ 

j^+m+l<j<jO^^-m-l 
R = Vn{I)exp(Lb-'/' Vjn{t)\ 

where J2n = {j G Jon :j<ji+m or j > — m} . Then it follows that 

n ^pBp R 

\p=2 J . 

Next, define the variables Ap,Bp and R^ by approximating Xj^s by xj^ 

with g = m£ for and with q = m£/12 for i^p and i?^. Then, by (A. 3), for 
anp = 2,...,L-l, 

E\Ap -Al\<C- b-^/^[l + \\t\\] ■ £mex.p{-Km£) 

E\Bp - Bl\ + E\R - Rl\ < C(|/|) ■cl[l + \\t\\] ■ £mexp(-Km^/[12]). 



H]!^^{t)EtVn{I) = E 
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Hence, 



.31) 



ER J] ApBp - ER^ W AlBl 

p=2 p=2 



< C{k, \I\)Kcl\\t\\imexp{-c{K)mi). 

Note that for any nonnegative function 'ip{X, Y) of random vectors X G M'^ 
and y S on (fi, J^, P) and a cr-field C C J- containing cr{X), a version of 
E['ip{X,Y)\C] is given by 

s[V^(x,y)|c]H=Vc(^M,w), uGn, 

where i/jcix,-) = f ip{x,y)^ic{']dy), x G R'^, and /^c(S") is the regular condi- 
tional probability distribution of Y on W given C [cf. Chapter 12, Athreya 
and Lahiri (2006)]. Hence, for any two a-fields C and T) containing (t{X) 
and for ^ : M'' x [0, M], M G (0, oo), we have 

E\E[^{X,Y)\C]- E[i,{X,Y)\V]\ 



\i^c{X{u:),u) - ijv{X{uo),u:)\P{du) 



i^{X{uj),y)^ic{uj,dy) - / il){X{uj),y)nv{^^,dy) 



P{duj) 



< 



.32) 



[Mc(a;,^(^M,rH[i,oo)) 



/ii,(w,^(X(w),-)"^([i,oo))](it 



P{duj) 



M 



< 1^ J \w{io,Hx{io),r\[t,^)) 

- il^{X{uj),-y'^{[t, oo))]\P{duj) dt 

<M-e\ sup \P{Y ^B\C)-P{Y eB\V) 

Next, for each p = 2, . . . , L — 1, define 

np = a{{Vy.je'L,ji[cp,d.p]]) 

and 

P* = CF{{Vj -.j G [op - mi, Cp) U {dp, bp + mi]}), 

where Op = (j° - m)i + 1 - m£, 6p = ( j° + m)^ + m£, Cp = (j° - [f J )^ + 1 , dp = 
(jp + Lf J + 1)^- Note that for each p = 2, . . . , L - 1, {wf^^^-.j = 1, bon} are 
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measurable w.r.t. both the cr-fields Vp and V*. Hence, using (6.32) repeat- 
edly (4 times) and assumption (A. 5), one can show that 



(6.33) 



max \E{Al\Vp) - E{Al\V;)\ < C exp{-C{K)ml). 



p=2,...,L-l 



Also, note that the variables i?^(np=2 ^p-^p)' ^1, n^=g+i ^p-^(^l'l^p) are 
all measurable w.r.t. Vq for every 2<q<L — \. Hence, it follows that 



L-1 



L-1 



.34) 



p=2 
L-1 

q=2 



p=2 



L-1 



ER^\{AlBl\B\[A\-E{A\\Vq)] J] bIe{AI\v;] 



\p=2 



p=q+l 



L-1 



+ CclY,E\E{Aq\Vq)-E{A\\Vl)\ 

q=2 

< C{K)clLex.p{—Kmi), 

since the first term vanishes. Now, using the fact that D* and T^p^i are 
separated by a distance > Cmi for all p, and using (6.31), (6.33), (6.34), 
one can conclude that 



\Hl^\t)EMl)\ 



<CclE 



L-1 



\[E{Al\v; 



p=2 
L-1 



+ C{\I\)Lcl{l + Wm) exp(-C(K)m^) 



< Ccl W E\E{Ap\Vp)\ + C{\I\)Lcl{l + ||t||£m)exp(-C(K)m£). 

p=2 

The first part of Lemma 6.6 follows from this. 

Next, we consider (6.30) and prove the first inequality. Let Z be a zero 
mean M'^-valued random vector on {Q,T,P) with £'||Z||^ < oo and let C C 
be a cr-field. Denote the conditional distribution of Z given C on (M'^, ;S(M'^)) 
by /Uc(-;-)- Then 

\EeM^/^t'Z\C)\^ 

= jj exp(\/^t'(3; - ?/))/ic(-,dx)^c(-,'^y) 
< 1 - E{{t'Z)^\C) + 2E{\t'Z\^\C) a.s. (P) 
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for all t£R^. Hence, by (A. 2), it follows that for all n>C, 



E 



\j-jo\<m 



sjexp^ 



V 



JO 



\j-jo\<m 



+ 



2hJ/'^E 



\j-jo\<m 



< 



< 



exp 



exp 



{-b-^[K/2]m\\tf + Cb-^/^\\tfm^) 



for all ||t|| < Cbl/"^ /m'^ , which proves the first bound on /3in(') in (6.30). 

Next, consider the second bound on /3in(-) in (6.30). Note that by iterating 
the inequality "1 — cos(2x) < 4(1 — cosx) for all x G R" for r-times (r G N), 
we have 1 — cos(2^'x) < 4^'(1 — cosx), j; S M. Hence, for any random variable 
Z and any cr-field C C J^, if the conditional distribution of Z given C is 
symmetric about the origin, then 

1 - ^[exp(i2'nZ)|C] < 4'"(1 - S[exp(mZ)|C]) 

for all n G M. Hence, for a random variable Zi and a subsigma-field G of J^, 
writing fJ-g {■',■) for the conditional distribution of Zi given G, and employing 
the above inequality, one can conclude (cf. page 223, [GH]) that 

1- |E(exp(i2^uZi)|g)|2 



1 



<4' 



j j exp(i2''u[zi - Z2])/Wg(-,d2i)/ig(-,c?22) 



1 



exp(m[zi - Z2])ng{-,dzi)fig{-,dz2) 



= 4^[l-|i?(exp(mZi)|g)|2] 
for all n € R. Hence, it follows that 



1 



(6.35) 



^ ^ \j-jo\<m ^ ^ 

i?(exp(/,2^ Y V:,„(t)) P,o) ) 



> 4"M 1 



|j"Jol<™ 
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> 4- 



1 — sup 

llt|l/V2<||j/||<V^||t|| 



\j~jo\<m 





2- 







for all t G R " and n > C, where in the last step, we have used (6.1) to 
conclude that there exists a C > such that for all n > C, 



-1|UI|2 



< \\{t[ + x'SYEC-^{t2),t2 



I n/||2 



<2||tf, 

uniformly in ||x|| < 2cnbn^^'^ and in t = {t'^.t'^)' x W^^ . 

Next, set ki = 2k where k as in (A. 6). Then, given a t G M"^" with \\t\\ < 
Kidn, let r = rt he such that 

2^-+i|itii ^ 2nitii 

> Kl > 



Then, 4-^ > [\\t\\/{V2KM? and by (A.6), 



E 



sup 

Pll/v^<bll<v^l|t|| 





2- 







<E 



< E 



sup 

.Kld„/2<||z||<2Kld„ 



^ ^ \j-jo\<m ^ 

S^exp^t2'^ ^ x'Wj^ 



li-io|<m. 





2- 







sup 

|x-||>Kd,i 



^(exp(t2'^ ^ rr'VFjn 

b-io|<m 





2- 







jo+m„ 

+ 2 P(^,n^W,n) 
j=jo-m„ 

<(1-k)+2 ^W^infc-^ 
j=jo-i-n„ 

<{1-[k/2]) 

for all n>C. Hence, from (6.35), for all ||t|| < 2Kdn, 



E 



^ ^ \j-jo\<m ^ ^ 

<\EE[e^p[L Y ^inW) ^io) 



|j-iol<m 



2 1 1/2 
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2Kldl 2, 

<exp(-C(K)||t||Vd^). 

It is easy to see that this bound holds uniformly over jo G {m + 1, . . . , 6on — 
m} and therefore, for n> C, we have 

(6.36) Pinit) < exp(-C(K)((i„6y2)-2||^||2) \\t\\ < 2Kb}/^dn. 
This completes the proof of (6.30) and hence of Lemma 6.6. □ 

Proof of Theorem 5.1. In view of the moment condition (A. 2), by 
Lemma 4.1(i) of [L] and (the proof of) Lemma 6.3 above, and by Theorem 
10.1, Corollary 11.5 and Lemma 11.6 of [BR] and by arguments similar to 
the proof of relation (20.39) in [BR], it is enough to show that 

(6.37) sup / \D"{H^^^{t)-fs,nmdt = 0{6n), 

\a\<do+l J \\5nt\\<l 

where Ts^„(-) is defined by replacing the cumulants of -S'„ + 6n^^^'^in in s,n(') 
with those of the truncated and centered version 5„ + 6n Cin- 

First, consider the integral in (6.37) over the set Bin = G ^'^ ■ INI < 
Gin}, where ein = [log n] [log log n] . By Lemma 9.7 in [BR] and the arguments 
on pages 231 and 232 in the proof of Lemma 3.33 of [GH], it is enough to 
show that there exists an rj £ (0,1) such that 



Qr 



9^ e=0 



Rn{t + ea] 



for ah r = 0, . . . ,4 + 1, t G A^, where i?„(t) = [/g (1 - 'u)^/c2 ([s]?' (i x 
t)]^(*+i))du]/s! is as in (6.7). In view of (6.3), (6.4), (6.7) and the multi- 
linearity of the semi-invariants, it is enough to estimate the sums 

(6.38) Y.Y}^^t\y3.n{ai),...,V,Uar)% r = s + 1, . . . , s + do + 1, 

j=0 



for t G Bin-, where ai, . . . , E M ° with ||aj|| < 1 for all 1 < i < r and where 
the sum ^ extends over all indices 1 < Ji < • • • < with maximal gap 
i. Note that for any s + \<r < s -\- d{)-\-l, 

E\\W,n\Y < c;r''HE\\Wjnr+H{\\W,n\\ < h\l^) 

(6.39) + c„^||l^,„|ri(||I^,„|| > h\l^)\ 

<C(r,s)c;-^-[-/4], 
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uniformly in 1 < j < feon- 

Also, by relation (6.1), Lemma 6.4 and (A. 2), for any t = (ti,t2)' ^ 
M*^^, there exists a u € [—1, 1] such that 



(6.40) 



\H^'Kt) - H^{t)\ 

< |6;=^/2^(.t'|i„exp(.t'5„ + tub-^/h'^^n))\ 

<6;2^|i5;{([3W^l„] + [3W^6o„n])' 



X SVEC-l(t2)[lT^in] exp{it'Sn + Lub'^/h' iin)}\ 



< Cb~^\\t\\ y max \EWniI) exp{Lt'Sn + iub-^^'h'l^n) 
~^^={ij}.{i.fton} 

<cb-^\\t\mn{t)+2-^}, 



where P2n{t) = max{|6'„,/(i)| : I = {k,j},k £ {l,bon},j G {1, . ■ • ,6on}} and 
Onj{t) is as in Lemma 6.4. By arguments in the proofs of Lemma 3.33 of 
[GH83] and Lemma 4.4 of [L] (with s = 3, q = 0), we have 

sup{P2nit)/\Hn{t)\:teBin}<C foT n > C and 
(6.41) Hn{t) = eM-t'^nt/2 + 0(||6;i/2^f )) 

uniformly in t G Bin, 

where S„ = Var(S'„). 

Next, let e2n = (logn)^ and fix r G {s + 1, . . . , s + + 1}. Then, applying 
(6.39), (6.40), (6.41), and Lemma 6.4 for i < e2n and applying (6.6), (6.40), 
(6.41) and Lemma 6.5 for e2n < ^ < ^On — 1) from (6.38), we get 

< y -r-i \uiax\EWn{I)\ ■ C + 2"^/ exp(-Cp|p 

ban-l 

< [-/^leL + C2-^exp(CeL) 
<Cb-J^-'^/'d--^'^/\lognf, 
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uniformly in t € Bin, for n> C. Hence, 



max 

\a\<do+l JteBir, 



Also, by (A.2), 



max 



\D^f,^nit)\dt = 0{b-^) 



\a\<do+lJ\\t\\>eir. 

for any a > 0. Therefore, it remains to show that 



(6.42) max / = ©(^-(^-^V^pogn]-^). 

\a\<do+l J \\t\\>ei„ 

Next, set m = logn if £ < n^^^ and set m = C = C{s,d, k) (a large but finite 
constant depending on s,d,K), otherwise. Then, using the first bound of 

(6.30) for ein < \\t\\ < Cbl/'^ /m"^, the second bound of (6.30) for bj/'^ /m"^ < 

\\t\\ < 2Kbl/'^dn, and Lemma 6.6 and condition (A. 6) for 2Kbl/'^dn < ||t|| < 

bn ^''^^[logn]^, one gets (6.42). This completes the proof of the theorem. 
□ 

6.3. Proof of the main result from Section 2. 

Proof of Proposition 2.1. As indicated in Section 2, we set Vj = 
a{£j), j G Z. Let V*^ = a{ej\j ^JqI), jo € Jn, where J„ is as in (A.6). Then, 
-Djo C V*^ , and hence, by the properties of the conditional expectation, it 
is enough to show that (2.3) holds with Dj^^ replaced with P*^. Using the 
independence of the e^'s, for any t = (t'l,^^' G M*^ x IR'^i and jo G J„, after 
some lengthy algebra, we get 

(/ jo+m \ 
exp I it' Y 
V j=jo-iri / 

r / {jo+m)e \ 

eI exp L Y1 [r^^%Xj + r%Yjn] 

^ V j={jo~m^l)i+l J 



.43) 



|E{exp(i[r^/2^;L„ + r%Rn(jo)]ej,e + 4^M„(t2)ejo^)}l> 



say. 



where 



Lr 



me 

E 

j=-{m+i)e 



A 
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mi i 
j=-{m+l)ek=0 

and Rn{jo) is a P*^ -measurable di x d matrix- valued random element sat- 
isfying £'||i?„(jo)|p < C£. Here and in the following, the generic constants 
and the order symbols do not depend on jo G J„ (i.e., uniform over jo £ Jn)- 
Next, write e = Ej^i (for notational simplicity). By interchanging the order 
of summation in the second summand in M„,(t2) and using (6.1), one can 
show that 



£'joi^n{t2)sjoe. - 



me / \ 

Y A'j VEC-^(t2) I Yl ^knAj+k I 
-—mi+1 \\k\<e / 



{*) 



+ YAjVEC \t2)WjknAj+k 



(6.44) 



mi 



t'^VEci Y X] '^'^"[^■^H^i+fce]' 

\j=-me+l\k\<l 

(*) 



+ Y ^jkniA'ji] [Aj+ki]' I , 



where Wkn = 1 if A; = and Wkn = Wkn for all 1 < A; < ^ , and where the 
sum extends over all j, k satisfying j e [— (m + l)£ + 1, —ml] U [mi + 

1, (m + 1)£] and I < k < i, and where WjknS some real numbers satisfying 
\wjkn\ < C for ah (j, A;) under Yl^*\ Note that the VEC(-)-term in (6.44) 
is a linear combination of the random vector U = VEC(ee'); We write this 
terms as DnU, where Dn is a di x di matrix. Next, using the condition 
lim.„_>.oo If fcn = 1 for every A: > 1 and the summability of ||^i||'s, one can 
show that for any x G M'^, 
/ mi 

Vj=_m£+1 \k\<£ 

(*) \ 



E 



Wjkn[A'jX][Aj^kx]' -AooXx'Ac 







as n 



DO. This implies that the matrix D„ has a limit (say D), defined by 
DU = VEc{Aooie'Aoo). 

Next, let Q{-) and Qn{-) denote the probability distributions of y = ([Aqoe]'; 
[DU]')' and Vn = ([L„e]', [DnU]')' , respectively. Since the distribution of e 
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has a nontrivial absolutely continuous component, by Lemma 2.2 of Bhat- 
tacharya and Ghosh (1978), the fc-fold convolution Q*^ of Q (where k = do) 
has an absolutely continuous component with respect to the Lebesgue mea- 
sure on M'^"'^, with density f^^^ (say). By Lusin's theorem [cf. Theorem 
2.5.12, Athreya and Lahiri (2006)], without loss of generality, we may as- 
sume that f'^^^ is continuous. (In fact, the continuity of /^^^ holds over a 
smaller set of positive measure, but that is enough for our purpose; we may 
just consider the absolutely continuous component restricted to this set.) 
Since Z)„, D, Ln — )■ A^o, and Q"^ is obtained from Q*^' by a linear trans- 
formation that is nonsingular for n large, it follows that for large n, Q**^ has 
an absolutely continuous component with respect to the Lebesgue measure 
on ]R'^°'^, with a density fn^^ (say). Now using the standard transformation 
technique formula for the density /n*^^ in terms of f^^\ we conclude that 



as n 



oo (a.e. 



Let (pn{t) denote the characteristic function of Vn and write Q*^s foi' 
singular part of Q^^. Then, it follows that for t G M'^", 



J exp{it'{xi^ hXk))dQ'^^{x] 



[where x = {x'^, . . . , x'^)' 



<Q 



*k 



+ 



exp 



{Lt'{xi + ---+Xk))fi''\x)dx 



<Qt(M'^«'=) + j\fl^)-f^^)\dx 



+ 



exp 



(.t'(xi + --- + Xfc))/(^')(x)dx 



Hence, for every k G (0,oo), there exist a (5 G (0, 1/2) and no = no(K) such 
that for all n > no , 



(6.45) 



sup I (t) I < 1 — 25. 

||t||>K 



Now using (6.43)~(6.45) and writing Bin = {\\Rn{k)\\ < Ci{5)tl'^], we have, 
for n>nQ, 



E 



= e( sup \^{r^'Hi + r%R^{k).rH2)\) where t = (t;,^)' 

\\t\\>Ci ^ 
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<max|^( sup W-^/Hi+r^Rn{joyt2,r't2)\), 

e( sup {\^{r^/Hi + r^Rn{joyt2, 

\\t\\>ce,\\t2\\<Ke 



< max< sup \ip{si,S2) 



1*2 



sup \ip{si,S2)\+ n (.■,2 

||si||>C(ft,<5)£l/2,s2 6Rdi Oll^Oj t 

where in the step before the last one, we have used the fact that ||t2|| < 
K^, \\t\\ > Ci =^ ||ti|| > (C — K,)i which, in turn, imphes that on the set Bin, 

\\i-'/^h-i-^Rnijo)%\\>\\i-'/H4-i-^Rn{jo)\\\M 

Hence, assumption (A. 6) holds with dn = Ci, n > 1. □ 
6.4. Proofs of the results from Section 3. 

Proof of Theorem 3.1. Let Si„ be the dx d symmetric matrix with 

(p,g)th element given by E{n~^Y,'i=iKtiP^l))^ (P^l) ^ where Y* is as 
in (2.1). Also, let 



f n(0) + Wkni^nik) + f 



k=l 



Then, it can be shown after some algebra that for all {p,q) G Aq, 
tn{p,q) - T.in{p,q) 



■ n 



^Y.^rn{p,q) + h"'"^Up,q) 
=1 

^(1 + n~^k)wknXn,pXn,c, 



(6.46) 



.k=0 



1 " 

^Y.y^n{p,q) 



1=1 



+ -2r 1 ^(1 + n~^k)wkn ^n"+'' + b~^'^UP, Q) 

\ k=0 J 
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= b:^^/^Ain{p,q) +b~^A2n{p,q) +b~^^^Asn{p,q), say, 
where Xn,p is the pth component of Xn and where ^n{p-,q) is the (p, g)th 
element of ^„ = n^/"^ SVE.c{Xn[zWin + zWbon]'), where sVFin = 

^:'/'Etl(ELi«^fcn)X, and zW,,n = ^-^'^T.Ll{l:LiWkn)Xn-^+l. Set 

-^kniPiO) = ^kniQiP) for p>q. Then, A^^ are dx d symmetric matrices 
with ||Afcn|| = Op{l) for k = 1,2,3. Next, by Taylor's expansion, for any 
p = l,...,d, 

(6.47) e;/i(X„) = D-^H{X^) + V n~\^\/^D^+-^ H{fi) • + 

\a\=l 

where, on the set {||X„ — < Sq}, the remainder term satisfies \Rin\ < 
sup{|D°i?(x)| : \\x - /ill < (5o, |a| = u{s) + 2}||Z„||'^(^)+in-['^(^)+il/2, for some 
5o> [determined by (A.l)(ii)]. In particular, = Op{6n,c)- 

Similarly, using assumptions (A.1)-(A.3) and moderate deviation inequal- 
ities for Xn [cf. Theorem 2.11, [GH], Theorem 2.4, Lahiri (1993)] and for 
sums of block variables WjnS (cf. Theorem 2.4, [L]), and Taylor's expansion, 
we get 

(6.48) , l°l=J' 

rn' = < + E ^^(^n - ri)^' + 0,(<5„,c), 

where ^(a;) = rr > 0, and g^^\x) = ^~22jjf' ^~ is its jth derivative 

at rr E (0,oo), j > 1. Combining (6.46), (6.47) and (6.48), after some lengthy 
algebra, we obtain 

Tn = Tin + Op{6n), 

where Tin is as in (3.1). Thus, the {s — 2)th-order Edgeworth expansions of 
Tn and Tin coincide, upto an error of order 0{6n)- It is clear that Tin is a 
smooth (infinitely differentiable) function of (n = {n^^'^Xn, -^=^ Y^iLi ^In + 

^n^Cn)'- Hence, using Theorem 5.1 and the transformation technique of 
Bhattacharya and Ghosh (1978), the (s — 2)th-order EE for Tin can be 
derived from a (s — 2)th-order EE for C^n- This completes the proof of the 
theorem. □ 

Proof of Proposition 3.2. Write ^jn = E|a|=j+i-^^"-H'(/")^n /("')> 
j > 0. Then, using (6.46) and (6.47), after some lengthy algebraic manipu- 
lations, one can show that 

Til - rln = h-y'Qin + n-l/2g2n + n-^/^^^^/^g^^ 
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(6.49) 
where 
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Qm = hifiYAinhifi), Q2n = 2 Z^[a'H^''\f,)]i:irMf^), 

\a\=l 
\a\=l 

|«|=1|/3|=1 

Here H^'^\^l) = {{D^'-'^^i H {pL))) is the d x d matrix of second-order partial 

(3) 

derivatives of H at ^u, and ^('j A*) is the d x 1 vector with pth component 
]j^i+^j+^pj{(^^'j^ p = 1, . . . , d. Then stochastic approximation Ti„ is now given 
by 

(6.50) 



Tin — ^ ^ (^jnGjni 



where ai„ = l, a2n = fen 03n = "' ^''^i a4n = fe„\ OSn = tn^^^f^ 



^"3/2 
07n — On 


, and where with -^jn= g^i) {tI^) / j\, j > 1, 


Gin = 


r^n^On, 


G2n = 


JlnZonQln, 


Csn = 


In^iri + 7ln^0n<52n, 


^471 = 


llnZonQsn + l2nZonQlni 


G^n = 


llnZonQin + llnZlnQln + '^j2nZonQlnQ2n, 


Cen = 


TlnZ2n + 7ln-Z'lnQ2n + 72n-^0n'32n + Tln-^OnQsn 


G7„ = 


llnZonQen + JSnZonQln + 272n-^0nQlnQ3n- 



Note that by arguments in the proof of Lemma 3.28 of [GH], for unit vectors 
X e M'*! and y E M'^i , 

\E{x'Ain){y'Zn)\ 

Y,J2^0vix'[2Win],y'[lW,n]) 
i=l j=l 
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(6.51) 



J2 Gov{x'[2Win],y'[lWjn]) 
«=1 \j-~i\<C 



+ 0{exp{-C{K)i)) 



CI CI ci 

<Cwn max r^/^y^y^y^\E{e'Xi,e'Xj,eM\ 

1=1 i=l A;=l 

+ 0(exp(-C(K)^)) 

provided w„ = max{|it;fc„, : 1 < A; < ^} = 0(1) as n — cxo. Thus, ^l'^EG2n = 
0(1). By similar arguments, \EG^n\ + I^Gynl = 0{\)~n'l'^ I'^l'^). Next note 

— 1/2 

that by (6.13) above and by Lemma 4.1 of [L], EG^n = 0{bn )• Also, by 
Lemma 3.28 of [GH], EG^n = 0(n"i/2). Hence, 

7 



i=i 



(6.52) 



-V2[^i/2^G2„ + ii^G'3„] + 0(6;^ 



n 



-1/2N 



= n 

= n-^l^pi^i^n + 0{h~^n-^'^), say. 
Next, define the pth cumulant of random variables Vi,. . . ,Vp by 



}Cp{Vi,...,Vp) 



d 



(6.53) 



dei 



_d_ 

dSr. 



X log£'exp(4eiVi H h e^^]) 



(assuming that the relevant partial derivatives exist). Also, for pi-\ \-pr = 

p, pi, . . . G N and random variables Wi, . . . , Wr, write JCp{Wi^^ , . . . , Wr^'') - 
^p(^i) ■ ■ ■ ) W^i; • • • ) ■ • ■ ; Wr) where on the right-hand side, Wi appears 
Pi-times, W2 appears p2-times, etc. Then, using the well-known formula for 
expressing cumulants of polynomials of random variables [cf. Section 2.3, 
Brillinger (1981)] in terms of cumulants of the random variables themselves. 
Lemma 4.1 of [L], and arguments similar to (6.51), we have: 



^2,71 — ^2{G\n) 

+ bn^['^bn'^^2{Gln,G2n) + 2/C2 (Gin , G'4„,) + ^2{G'^n)] 

+ n~\2n^l^K2{Gin,G^n) 

.54) +2^^l\1C2{G2nAin) + ^2{Gln,G^n)] 

+ 2K.2{Gln,GQn) +^2(^1^)] 
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+ 0{b~^ + b~'n~'/') 
= el + b-^P2,i,n + n-^P2,2,n + 0{b~^ + b~^n~^/^), say; 

X3,n = n-'/^n'/^lCsiGll) + 3^i/2^3(G?n, G2n) + 3/C3(G?L Gsn)) 
(6.55) + 6;3/2/C3(G^2 ^ + 0(6;^n-i/2) 

= n^V2^3,i,n + fen'/'/33,2,n + 0{b~\-^/^), Say; 

-^4,71 = b~^[Abl/'^JCi{Gll,G2n) + 6/C4(G'i^,G'2n)] 

+ £^/^{12/C4(G'i^, G'2n, Gsn) + 4/C4(G'i^, Gsn)} 
+ A£)C4{Gln,G4n) + 6IC4^{Gln,Gln) + ^K^^iGln, Ggn)] 

+ b-^/HlC^iGll Gm) + 0{b-^ + n-^b-^/^) 

= b-^P4,l,n + n"V4,2,n + b-^/^^4,3,n + 0(6" ^l'^/^)^ gg^y. 

where recall that = t^/tI^ and where the /3rj,n-terms in (6.52)-(6.56) are 
0(1) as n — )• oo. Further, by similar arguments, X^^n = 0{b~^n~^^^). 
Next, combining (6.52)-(6.56), and using the relation 



(6.56) 



exp{itx)[a~'' Hkix/a)(j)aix)]dx = {ity exp{-ray2), t£R, 

one can express that the density of the preliminary EE for T„ with error 
of order o(n~^) as 



-3/2, 
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X S ^ 



where, with Hkn{x) = e^^Hk{x/ek),x G M, /c > 1, 

qin{x) = Pl^l,nHln{x) + /33,l,„i?3n(x)/6, 
q2n{x) = hxnH2n{x)/2 + /34,i,„F4„(x)/24, 
93n(2;) = [/32,2,n^2n(2;)/2 + /34,2,n^4n(a;)/24] 

(6.57) 

+ [(3l^^^H2n{x)/2 + /32 i,„/?6„(x)/72 
+ /3i,i,n/33,i,n-f^4n(a:;)/6], 

qAn{x) = /33,2,nH3n{x)/6 + /34,3,„i74„(x)/24, 

xeR. 
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Next, suppose that = (e~^ — 1) = 0{n~^^^). Then using the relation 

H(^k+l)n{y)4>e„ (y) dy = -Hkn{x)(l)e^{x), X S M, 

and Taylor's expansions, one can expand the preliminary EE for r„ to derive 
(3.8), where the respective polynomials Pin{x), x S M, are given by 

P2nix) = Pz^l^ne~'^xH^{x), 

4!e 



(6.58) 



Vin{x) 

Pin{x) 
P5n{x) 



^^i(-) + ^^3(x) 



2 ^^^^ 3 (a;) 



+ 



a^ix) + 



/3l,l,n/33,l,n 



72 ^ ' 6 
P4n(a;) = -[/33,2,ni^2(a;)/6 + /34,3,ni^3(a;)/24] 

6.5. Proofs of results from Section 4- 



H^ix) 



□ 



Proof of Theorem 4.1. The block resampling estimator of Cov(Z„) 
is location invariant, and hence, w.l.g., we again set = (for notational 

[21 

simplicity). Let Sf^^ = EUnU[^. It is easy to check that 

N 



„0l2 



1 



2n 



.59) 



+ 6-3/2i|l(p,g), say. 



where = Yl!k=i '^kn, and 



k=l 



i=N+k 
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is the edge-effect term. Note that the three terms in (6.59) are exactly of 
the same form as those in (6.46). Hence, an (s — 2)th-order EE for TA can 
be derived retracing the proof of Theorem 3.1. We omit the details. □ 

Proof of Theorem 4.2. Since there is no mean correction, it is easy 
to verify that — EUnU^i has the same expansion as in (6.59), with 

[31 

^kn = for k = 2,3. Hence, an EE for Tn can be derived directly from the 
EE results of [L], using the transformation technique of Bhattacharya and 
Ghosh (1978). □ 
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